-- Logs begin at Fri 2022-09-09 14:18:43 UTC, end at Fri 2022-09-09 15:15:15 UTC. -- Sep 09 14:43:12.928579 dv-cinder-828696-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 14:43:12.937311 dv-cinder-828696-11-smb devstack@keystone.service[81499]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 14:43:12 2022] *** Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: nodename: dv-cinder-828696-11-smb Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: machine: x86_64 Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: clock source: unix Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: pcre jit disabled Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: detected number of CPU cores: 4 Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: current working directory: / Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: detected binary path: /usr/bin/uwsgi-core Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: your processes number limit is 47680 Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: your memory page size is 4096 bytes Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: detected max file descriptor number: 2048 Sep 09 14:43:12.939374 dv-cinder-828696-11-smb devstack@keystone.service[81499]: lock engine: pthread robust mutexes Sep 09 14:43:12.940102 dv-cinder-828696-11-smb devstack@keystone.service[81499]: thunder lock: enabled Sep 09 14:43:12.940102 dv-cinder-828696-11-smb devstack@keystone.service[81499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 14:43:12.940102 dv-cinder-828696-11-smb devstack@keystone.service[81499]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 14:43:12.979839 dv-cinder-828696-11-smb devstack@keystone.service[81499]: Python main interpreter initialized at 0x55fd407819c0 Sep 09 14:43:12.979839 dv-cinder-828696-11-smb devstack@keystone.service[81499]: python threads support enabled Sep 09 14:43:12.979839 dv-cinder-828696-11-smb devstack@keystone.service[81499]: your server socket listen backlog is limited to 100 connections Sep 09 14:43:12.979839 dv-cinder-828696-11-smb devstack@keystone.service[81499]: your mercy for graceful operations on workers is 90 seconds Sep 09 14:43:12.980163 dv-cinder-828696-11-smb devstack@keystone.service[81499]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 14:43:12.980243 dv-cinder-828696-11-smb devstack@keystone.service[81499]: *** Operational MODE: preforking *** Sep 09 14:43:12.980464 dv-cinder-828696-11-smb devstack@keystone.service[81499]: *** uWSGI is running in multiple interpreter mode *** Sep 09 14:43:12.980464 dv-cinder-828696-11-smb devstack@keystone.service[81499]: spawned uWSGI master process (pid: 81499) Sep 09 14:43:12.980658 dv-cinder-828696-11-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 14:43:12.981728 dv-cinder-828696-11-smb devstack@keystone.service[81499]: spawned uWSGI worker 1 (pid: 81510, cores: 1) Sep 09 14:43:12.981728 dv-cinder-828696-11-smb devstack@keystone.service[81499]: spawned uWSGI worker 2 (pid: 81511, cores: 1) Sep 09 14:43:12.981728 dv-cinder-828696-11-smb devstack@keystone.service[81499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 14:43:17.252983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:43:17.252983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: from cryptography.utils import int_from_bytes Sep 09 14:43:17.253767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:43:17.253767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: from cryptography.utils import int_from_bytes Sep 09 14:43:17.254290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:43:17.254290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: from cryptography.utils import int_from_bytes Sep 09 14:43:17.254749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 14:43:17.254749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: from cryptography.utils import int_from_bytes Sep 09 14:43:17.303727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 14:43:17.303903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 14:43:17.304053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 14:43:17.304148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] command line args: [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 14:43:17.304249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 14:43:17.304333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 14:43:17.304442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] command line args: [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 14:43:17.304532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ================================================================================ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 14:43:17.304711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 14:43:17.304788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] admin_token = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.304889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ================================================================================ {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 14:43:17.304966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config_dir = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] admin_token = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] config_source = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] config_dir = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] debug = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] config_source = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.305967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] debug = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.306965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_config_append = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] list_limit = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] log_config_append = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_dir = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] log_dir = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.307947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] log_file = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.308941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.309948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.310931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.311019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.311810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] publish_errors = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] publish_errors = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.312922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] standard_threads = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.313850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] standard_threads = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_journal = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_json = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] use_journal = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_stderr = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] use_json = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] use_syslog = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.314937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] use_stderr = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.315066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.315144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] use_syslog = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.315297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 14:43:17.315372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.315535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.315617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.315775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.315852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.316956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.317991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.318979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.319930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.320891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.321952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.322983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.323926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324615 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.324985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.325963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.326959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.327857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.328996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.329156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.329481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.329641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.329712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.329874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.329952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330109 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.330898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.331841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.332935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.333943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.334892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.335982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.336999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.337904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.338974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.339990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.external = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.340934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] auth.external = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.password = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] auth.token = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.341874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] auth.password = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] auth.token = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.342837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.343933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] credential.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.344970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.345917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.346933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.347883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.348964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.349980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.350956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351109 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.351868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.352950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.353983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354881 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.354958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.355874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.356949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.357025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.357185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.357263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.357428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.357505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.357660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.357739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.358473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.358620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.358744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.358859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.358955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.359852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.360906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.361845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.362955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.363986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.364914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.365975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.366964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.367968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.368898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.369974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.370947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.371937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.372882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.373036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.373124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.373269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.373346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.373498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.373666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.374489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.374572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.374645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.374717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.374885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.374962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] role.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] role.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.375917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.376883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.377992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.378070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.378257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.378336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.378499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.378650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.378886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.378965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.379930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.380887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.381957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.382997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.383901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.384851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.385932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.386986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387231 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.connection = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.387966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.388899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.389052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.389150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.389819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.389904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.390062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.390363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.390453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.390630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.390709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.390876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.390954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391435 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.391914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.392063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.392141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.392294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.392372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.392463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 14:43:17.392550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.392757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 14:43:17.392930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 14:43:17.422706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.422863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.422964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.423042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.423115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.423255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.431383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.431552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.460161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.460386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.461371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.461606 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.514750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.515036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.564165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.564394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.564823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.565062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.721380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.721509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.721599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.721675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.721813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.721900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.722029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.722131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.722272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.722356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.722481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.722565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.745367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.745595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.745680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.745834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.745918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.746923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.758539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.758664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.771897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.772963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.773106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.773186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.773260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.773332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81511) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.773414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81510) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 14:43:17.789844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.790054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 14:43:17.790163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.790345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 14:43:17.790428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.790614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 14:43:17.790697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.790871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 14:43:17.790953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.791133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.791222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.791391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.791472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.791646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.791725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.791896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.801505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.801605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.801787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.801871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.802052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.802165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.802360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.802443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.809343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.809438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.812858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.812956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.813141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.813225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.813424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.813506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.813702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.813784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.813982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.814063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.814266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.814369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.814535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.814617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.814803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.814884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.815073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.815154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.815343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.815422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.815608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.815688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.839342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.839439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.840829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.840912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.841113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.841208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.845912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.846167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.846255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.846398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.846536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.846682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.852909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.853141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.853224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.853428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.858907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.859201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.859288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.859490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.859573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.859773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.859855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.860935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.861121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.876867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.877143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.877274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.877552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.880962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.881384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.884181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.884478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.884617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.884916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.888639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.889101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.892343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.893164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.895572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.895870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.896155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.896437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.896519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.896716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.896807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.897004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.897087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.897287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.897566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.897847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.912971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.913256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.913520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.913776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.913859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.914066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.914358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.914627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.921166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.922132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.922741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.923683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.924263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.924535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.925232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.925510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.927223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.927506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.927787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.928074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.928196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.928470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.928554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.928765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.929049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.929444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.939693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.939976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.940254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.940533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.940802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.940899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.941090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.941174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.941373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.941456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.941655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.942033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.942351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.942641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.957623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.958939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.960555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.961853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.963471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.964788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.964923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.966274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.966398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.966679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.967074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.968341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.968624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.969029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.973983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.975464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.975550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.976932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.978377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.978774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.979062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.979334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.979845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.980244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.980531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.980811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.987844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.988132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.988409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.989473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.989768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.990052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.995311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81510) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.995593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.995871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.996152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.996424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.996693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.996965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.997058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81511) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 14:43:17.997238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.997322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.997513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.997593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.997789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.997884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.998064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.998211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.998362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.998445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.999178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.999309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.999437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81510) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.999537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:17.999848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:18.000133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:18.000420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:18.000688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:18.000965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:18.001280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81511) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 14:43:18.037213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd407819c0 pid: 81510 (default app) Sep 09 14:43:18.038413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd407819c0 pid: 81511 (default app) Sep 09 14:43:18.040897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90bc24-01bc-41b7-875c-9f2ec200016f None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:18.041243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90bc24-01bc-41b7-875c-9f2ec200016f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:18.041654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90bc24-01bc-41b7-875c-9f2ec200016f None None] PATH_INFO: `/v3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:18.046932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Fri Sep 9 14:43:18 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:24.768696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafef5bd-c08d-4ee2-9fe2-81d408922ee4 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:24.769162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafef5bd-c08d-4ee2-9fe2-81d408922ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:24.769270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafef5bd-c08d-4ee2-9fe2-81d408922ee4 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:24.773429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:24.778601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:24.779040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:24.779177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:24.850017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: INFO dbcounter [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] Registered counter for database keystone Sep 09 14:43:24.869266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG oslo_db.sqlalchemy.engines [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:43:24.876005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writer thread running {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:43:25.061772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG passlib.handlers.bcrypt [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81510) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 14:43:25.062204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG passlib.handlers.bcrypt [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81510) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 14:43:25.120472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:25.122080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:25.248324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 14:43:25.712342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafef5bd-c08d-4ee2-9fe2-81d408922ee4 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:25.784370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: INFO dbcounter [None req-dafef5bd-c08d-4ee2-9fe2-81d408922ee4 None None] Registered counter for database keystone Sep 09 14:43:25.805687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG oslo_db.sqlalchemy.engines [None req-dafef5bd-c08d-4ee2-9fe2-81d408922ee4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 14:43:25.811893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writer thread running {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 14:43:25.931860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafef5bd-c08d-4ee2-9fe2-81d408922ee4 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:25.936083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae3c74-c28d-48f5-b85b-85f81c065f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:25.936700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3c74-c28d-48f5-b85b-85f81c065f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:25.937501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3c74-c28d-48f5-b85b-85f81c065f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:25.938240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae3c74-c28d-48f5-b85b-85f81c065f9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:25.946300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3c74-c28d-48f5-b85b-85f81c065f9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:25.998412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7bae3c74-c28d-48f5-b85b-85f81c065f9d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 14:43:25.998700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae3c74-c28d-48f5-b85b-85f81c065f9d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:26.008889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Fri Sep 9 14:43:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 14:43:26.014815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:26.032642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3caee-90d2-47d2-bee6-341b14f4369b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:26.037053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d55b-116f-4cf5-aea5-6e7c82f8b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:26.038233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d55b-116f-4cf5-aea5-6e7c82f8b7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:26.038522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d55b-116f-4cf5-aea5-6e7c82f8b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:26.038807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d55b-116f-4cf5-aea5-6e7c82f8b7c3 admin admin] PATH_INFO: `/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:26.040387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466d55b-116f-4cf5-aea5-6e7c82f8b7c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=30e9f440e31a4fa8b27ec296ec84b4a3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:26.093562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2466d55b-116f-4cf5-aea5-6e7c82f8b7c3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 14:43:26.093905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466d55b-116f-4cf5-aea5-6e7c82f8b7c3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:26.098424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Sep 9 14:43:26 2022] GET /identity/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:28.411256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58755f8-5a7e-4f20-b9a6-558096b13f28 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:28.411823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58755f8-5a7e-4f20-b9a6-558096b13f28 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:28.411823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58755f8-5a7e-4f20-b9a6-558096b13f28 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:28.415875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:28.421927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc962d-28d6-4ccd-b0e7-d0beaeebb72f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:28.422485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc962d-28d6-4ccd-b0e7-d0beaeebb72f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:28.422485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc962d-28d6-4ccd-b0e7-d0beaeebb72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:28.442766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e3bc962d-28d6-4ccd-b0e7-d0beaeebb72f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:28.444281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e3bc962d-28d6-4ccd-b0e7-d0beaeebb72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:28.452002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 09 14:43:28.731373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58755f8-5a7e-4f20-b9a6-558096b13f28 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:28.743887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58755f8-5a7e-4f20-b9a6-558096b13f28 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:28.748016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d03fa-b5ef-42c8-a7de-fd6b0289024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:28.748611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d03fa-b5ef-42c8-a7de-fd6b0289024f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:28.748889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d03fa-b5ef-42c8-a7de-fd6b0289024f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:28.749159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d03fa-b5ef-42c8-a7de-fd6b0289024f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:28.757367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d03fa-b5ef-42c8-a7de-fd6b0289024f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:28.759175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d03fa-b5ef-42c8-a7de-fd6b0289024f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:28.767883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Fri Sep 9 14:43:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 14:43:28.773074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc962d-28d6-4ccd-b0e7-d0beaeebb72f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:28.782673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc962d-28d6-4ccd-b0e7-d0beaeebb72f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:28.786985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc00f-c53e-43d1-bb08-b9422db66f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:28.787596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc00f-c53e-43d1-bb08-b9422db66f58 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:28.787874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc00f-c53e-43d1-bb08-b9422db66f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:28.788145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc00f-c53e-43d1-bb08-b9422db66f58 admin admin] PATH_INFO: `/v3/users/4da2a13608794bc8b00af153bd2654b1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:28.789483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc00f-c53e-43d1-bb08-b9422db66f58 admin admin] RBAC: Authorizing `identity:get_user(user_id=4da2a13608794bc8b00af153bd2654b1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:28.791328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefc00f-c53e-43d1-bb08-b9422db66f58 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:28.792833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Fri Sep 9 14:43:28 2022] GET /identity/v3/users/4da2a13608794bc8b00af153bd2654b1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:30.995422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a85f-5bf5-4bc7-93dd-2761f587fc4f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:30.995919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a85f-5bf5-4bc7-93dd-2761f587fc4f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:30.995919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641a85f-5bf5-4bc7-93dd-2761f587fc4f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:30.997201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:31.002999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d26f2-706a-46eb-9d66-a8a5eb7c1194 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.003415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d26f2-706a-46eb-9d66-a8a5eb7c1194 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.003518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d26f2-706a-46eb-9d66-a8a5eb7c1194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.022363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c13d26f2-706a-46eb-9d66-a8a5eb7c1194 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:31.023526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c13d26f2-706a-46eb-9d66-a8a5eb7c1194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:31.046055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44288e6-e4bc-4d00-ab17-022f6c2f2745 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.046420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44288e6-e4bc-4d00-ab17-022f6c2f2745 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.046705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44288e6-e4bc-4d00-ab17-022f6c2f2745 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.048140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:31.053898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.054210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.054489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.097134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG passlib.handlers.bcrypt [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81511) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 14:43:31.097526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG passlib.handlers.bcrypt [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81511) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 14:43:31.105272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:31.146942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:31.148535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:31.247089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:31.372075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d26f2-706a-46eb-9d66-a8a5eb7c1194 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:31.397040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:31.477032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d26f2-706a-46eb-9d66-a8a5eb7c1194 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:31.510506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:31.511078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.511388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.511662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.514955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:31.523023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:31.531883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:31.532800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:31.533617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:31.538625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:31.619283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b19e8-0d4c-4ff8-b805-681583dd1f47 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:31.621514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:31.622077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:31.642617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700b5e6-5eff-49fc-af06-050416470e39 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:31.657549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:31.658451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.658738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.659007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.676347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:31.676945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.677222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.677499 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.678185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:31.678487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:31.679877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:31.692624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:31.698390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:31.730701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:31.732233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:31.797373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf8ba0-171d-4a66-8214-92eee6aafe49 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:31.828855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 14:43:31.830531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:31.831168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.831444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.831716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] PATH_INFO: `/v3/users/4da2a13608794bc8b00af153bd2654b1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.832861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] RBAC: Authorizing `identity:get_user(user_id=4da2a13608794bc8b00af153bd2654b1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:31.834341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:31.834771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:31.835895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:31 2022] GET /identity/v3/users/4da2a13608794bc8b00af153bd2654b1 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:31.837489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:31.841121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:31.856219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:31.934422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c4e1d-0ed9-4223-84a1-f76453f75f65 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:31.941192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e307325-4c10-49c8-8efe-5169c5f5dd66 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:31.969175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:31.970023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.970347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.970623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.975727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:31.976347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:31.976627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:31.976894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:31.977997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:31.979456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:31.981222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 10/18] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:31.987394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:31.989549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:31.991309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:43:32.009224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:32.010592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:43:32.011377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:43:32.011377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:43:32.011377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:32.011377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 9/19] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:43:32.017641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:32.066842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:32.073793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:32.086704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389d167-652f-41a5-b1fc-62c275dc6305 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:32.120581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028919fa-4f34-42a5-8ce7-055403538fe8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:32.120946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9031ac-ceef-4dd9-aa70-0f84ccccb39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:32.121552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9031ac-ceef-4dd9-aa70-0f84ccccb39e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:32.121830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9031ac-ceef-4dd9-aa70-0f84ccccb39e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:32.122125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9031ac-ceef-4dd9-aa70-0f84ccccb39e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:32.122852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9031ac-ceef-4dd9-aa70-0f84ccccb39e None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.domain.id=default, user.id=4da2a13608794bc8b00af153bd2654b1) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:32.123161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9031ac-ceef-4dd9-aa70-0f84ccccb39e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:32.124703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9031ac-ceef-4dd9-aa70-0f84ccccb39e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:32.131231 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Fri Sep 9 14:43:31 2022] GET /identity/v3/role_assignments?user.id=4da2a13608794bc8b00af153bd2654b1&scope.domain.id=default&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:32.155192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb469-c6eb-47b4-90ba-da6627bfb449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:32.155968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb469-c6eb-47b4-90ba-da6627bfb449 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:32.156360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb469-c6eb-47b4-90ba-da6627bfb449 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:32.156634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb469-c6eb-47b4-90ba-da6627bfb449 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:32.157306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb469-c6eb-47b4-90ba-da6627bfb449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:32.157613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb469-c6eb-47b4-90ba-da6627bfb449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:32.159088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb469-c6eb-47b4-90ba-da6627bfb449 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:32.178913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:34.632980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84519-3b3c-4b37-b100-92aad0e5f4f3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:34.633487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84519-3b3c-4b37-b100-92aad0e5f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:34.633558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84519-3b3c-4b37-b100-92aad0e5f4f3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:34.634892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:34.640295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa958ca-b041-46b9-b14e-598249526353 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:34.641115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa958ca-b041-46b9-b14e-598249526353 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:34.641619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa958ca-b041-46b9-b14e-598249526353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:34.667120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-bfa958ca-b041-46b9-b14e-598249526353 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:34.668647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bfa958ca-b041-46b9-b14e-598249526353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:34.757583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:35.006823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa194a3-e8d9-42bd-969f-6f5fe5112fa9 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.007509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa194a3-e8d9-42bd-969f-6f5fe5112fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.007984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa194a3-e8d9-42bd-969f-6f5fe5112fa9 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.009749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:35.015072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e5fd9-2b32-413c-9590-15992c3117a2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.016220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e5fd9-2b32-413c-9590-15992c3117a2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.016711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e5fd9-2b32-413c-9590-15992c3117a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.035830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e52e5fd9-2b32-413c-9590-15992c3117a2 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:35.037393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e52e5fd9-2b32-413c-9590-15992c3117a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:35.073894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e409b-a960-4a06-aeef-996c0844a300 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.074535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e409b-a960-4a06-aeef-996c0844a300 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.074997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e409b-a960-4a06-aeef-996c0844a300 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.076516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 14/25] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:35.082748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58f74-b42b-47b2-ad22-2d6511b5f18f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.083277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58f74-b42b-47b2-ad22-2d6511b5f18f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.083752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da58f74-b42b-47b2-ad22-2d6511b5f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.096037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:35.103831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8da58f74-b42b-47b2-ad22-2d6511b5f18f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:35.105252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8da58f74-b42b-47b2-ad22-2d6511b5f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:35.142713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 12/26] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:35.145237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07322ad9-5265-4a70-96b8-baaed86a7325 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.145517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07322ad9-5265-4a70-96b8-baaed86a7325 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.145787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07322ad9-5265-4a70-96b8-baaed86a7325 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.147057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:35.154271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd0b8-f0ff-4bbb-9a35-c44d236ac4d9 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.154551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd0b8-f0ff-4bbb-9a35-c44d236ac4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.154822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd0b8-f0ff-4bbb-9a35-c44d236ac4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.180932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-bb3fd0b8-f0ff-4bbb-9a35-c44d236ac4d9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:35.182389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bb3fd0b8-f0ff-4bbb-9a35-c44d236ac4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:35.250432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 15/28] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:35.252538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da58f74-b42b-47b2-ad22-2d6511b5f18f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:35.340334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 14/29] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:35.392577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:35.423676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da58f74-b42b-47b2-ad22-2d6511b5f18f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:35.431617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fd0b8-f0ff-4bbb-9a35-c44d236ac4d9 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:35.484696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:35.486514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.486798 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.487069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.507100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:35.509315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:43:35.530180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:35.531094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:43:35.531873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:43:35.531873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:43:35.531873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:35.533983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 16/30] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:35.540259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:35.610163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fd0b8-f0ff-4bbb-9a35-c44d236ac4d9 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:35.620629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:35.668584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:35.669240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349e5a-e699-4be4-aaf3-a4feb3cb5e2b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:35.670406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.670879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.671367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.672692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:35.674319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:35.699998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:35.709554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:35.710511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.711022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.711507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.712342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:35.712856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:35.714480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:35.741886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 17/31] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:35.743029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:35.858297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aa793-67d7-4356-a048-a76bfc798020 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:35.863182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 15/32] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Sep 9 14:43:35 2022] POST /identity/v3/roles => generated 219 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:43:35.864302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:35.907878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:35.908512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:35.908838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:35.909113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:35.909798 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:35.911313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:36.059509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 18/33] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Sep 9 14:43:35 2022] POST /identity/v3/roles => generated 225 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:43:36.060561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:36.101623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692aa8d-0a61-4149-835e-4744def1e09f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:36.118557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:36.179360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:36.180250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.180694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.181119 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.182293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:36.186835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:36.215533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929ba75-93a9-4b54-994a-f19f4375ea91 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:36.250222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 16/34] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:43:35 2022] POST /identity/v3/projects => generated 301 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:43:36.277251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:36.278154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.278591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.278998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.294131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:36.301435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:36.302387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:36.303144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 19/35] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:36.309843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:36.336313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:36.432396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a34c-d87d-4e77-96ed-611a160511dd None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:36.477702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3120e-fafa-4f72-861c-4f771a2e2e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:36.478360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3120e-fafa-4f72-861c-4f771a2e2e9e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.478640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3120e-fafa-4f72-861c-4f771a2e2e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.478912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3120e-fafa-4f72-861c-4f771a2e2e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.479587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3120e-fafa-4f72-861c-4f771a2e2e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:36.479891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3120e-fafa-4f72-861c-4f771a2e2e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:36.481301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3120e-fafa-4f72-861c-4f771a2e2e9e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:36.502421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 17/36] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:36.508477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:36.623759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039254f1-d082-4d94-bd2a-f10e4ac7db8a None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.624104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039254f1-d082-4d94-bd2a-f10e4ac7db8a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.624319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039254f1-d082-4d94-bd2a-f10e4ac7db8a None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.626384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 18/37] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:36.628584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774caa83-292e-4e9b-84cf-383977e2e8fe None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:36.632478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f655-f7ed-4723-945f-8d2575a5e0d6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.632765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f655-f7ed-4723-945f-8d2575a5e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.633039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f655-f7ed-4723-945f-8d2575a5e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.637903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:36.653468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7ad5f655-f7ed-4723-945f-8d2575a5e0d6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:36.655085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7ad5f655-f7ed-4723-945f-8d2575a5e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:36.671286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aa820-a25b-4434-813c-084eee345bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:36.673235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa820-a25b-4434-813c-084eee345bef None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.673694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa820-a25b-4434-813c-084eee345bef None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.674236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa820-a25b-4434-813c-084eee345bef None admin] PATH_INFO: `/v3/users/4da2a13608794bc8b00af153bd2654b1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.675662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aa820-a25b-4434-813c-084eee345bef None admin] RBAC: Authorizing `identity:get_user(user_id=4da2a13608794bc8b00af153bd2654b1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:36.677526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aa820-a25b-4434-813c-084eee345bef None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:36.679421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:36 2022] GET /identity/v3/users/4da2a13608794bc8b00af153bd2654b1 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:36.685883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aa820-a25b-4434-813c-084eee345bef None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:36.733833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 19/39] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:36.760018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21fb45-4fc0-4621-af54-8aa5a798e0b5 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.760308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21fb45-4fc0-4621-af54-8aa5a798e0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.760607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21fb45-4fc0-4621-af54-8aa5a798e0b5 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.761940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 20/40] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:36.767014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95d21-6425-4e8e-86c6-0f8c18bacfcf None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.767299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95d21-6425-4e8e-86c6-0f8c18bacfcf None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.767575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95d21-6425-4e8e-86c6-0f8c18bacfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.787356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7ce95d21-6425-4e8e-86c6-0f8c18bacfcf None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:36.788557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7ce95d21-6425-4e8e-86c6-0f8c18bacfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:36.791311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:36.800205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aa820-a25b-4434-813c-084eee345bef None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:36.862483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 21/41] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:36.950344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:36.951190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:36.951609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:36.952041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:36.954260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:36.956073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:36.957754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 21/42] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:36.963636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95d21-6425-4e8e-86c6-0f8c18bacfcf None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:37.000623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:37.045714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:37.074111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95d21-6425-4e8e-86c6-0f8c18bacfcf None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:37.107850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def6e4-d4d3-4d0e-bece-d76cc2d93810 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:37.111114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:37.111319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:37.111577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:37.111855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] PATH_INFO: `/v3/domains/default/users/4da2a13608794bc8b00af153bd2654b1/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:37.114031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4da2a13608794bc8b00af153bd2654b1, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:37.115522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:37.128526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:37.132357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 22/43] 10.222.0.52 () {58 vars in 1361 bytes} [Fri Sep 9 14:43:36 2022] PUT /identity/v3/domains/default/users/4da2a13608794bc8b00af153bd2654b1/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:43:37.143199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:37.154314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:37.155418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:37.155709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:37.156525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:37.157885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:37.159521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:37.176544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Sep 9 14:43:36 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:43:37.270142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8e993-faf0-46c3-a05f-906c4ff84082 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:37.310194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b9d9-b238-40c8-8e30-b5e4758ba711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:37.310848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b9d9-b238-40c8-8e30-b5e4758ba711 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:37.311127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b9d9-b238-40c8-8e30-b5e4758ba711 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:37.311396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b9d9-b238-40c8-8e30-b5e4758ba711 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:37.312912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b9d9-b238-40c8-8e30-b5e4758ba711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:37.314941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b9d9-b238-40c8-8e30-b5e4758ba711 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:37.318776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 23/45] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:37.323613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:37.433715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a5360-91ce-4e41-8479-8d42988d1667 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:37.435296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:37.469210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be15f3-feb4-4b30-8705-865c54247938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:37.469821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be15f3-feb4-4b30-8705-865c54247938 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:37.470122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be15f3-feb4-4b30-8705-865c54247938 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:37.470396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be15f3-feb4-4b30-8705-865c54247938 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:37.471051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be15f3-feb4-4b30-8705-865c54247938 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:37.472483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be15f3-feb4-4b30-8705-865c54247938 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:37.501084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:43:37 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:43:39.337254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279305-5784-4864-8917-dfb1690266b5 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:39.337810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279305-5784-4864-8917-dfb1690266b5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:39.337810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18279305-5784-4864-8917-dfb1690266b5 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:39.339161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 24/47] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:39.344804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eca1a8-3213-4d49-940b-250a722b37dd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:39.345213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eca1a8-3213-4d49-940b-250a722b37dd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:39.345353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eca1a8-3213-4d49-940b-250a722b37dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:39.363922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-29eca1a8-3213-4d49-940b-250a722b37dd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:39.365459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-29eca1a8-3213-4d49-940b-250a722b37dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:39.431292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 24/48] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:39.640757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5ac0-208d-4a80-9afb-add47edc81e9 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:39.641067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5ac0-208d-4a80-9afb-add47edc81e9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:39.641421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5ac0-208d-4a80-9afb-add47edc81e9 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:39.642892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 25/49] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:39.648173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bdc8-64d3-40fc-aee3-0ac73cd3a137 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:39.648456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bdc8-64d3-40fc-aee3-0ac73cd3a137 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:39.648726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bdc8-64d3-40fc-aee3-0ac73cd3a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:39.666447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4988bdc8-64d3-40fc-aee3-0ac73cd3a137 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:39.667607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4988bdc8-64d3-40fc-aee3-0ac73cd3a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:39.701077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb5ac0-208d-4a80-9afb-add47edc81e9 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:39.736974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 25/50] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:39.769295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:39.803703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb5ac0-208d-4a80-9afb-add47edc81e9 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:39.836143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:39.836765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:39.837044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:39.837315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:39.848650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:39.854664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:39.855537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:39.856270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 26/51] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:43:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:39.862138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988bdc8-64d3-40fc-aee3-0ac73cd3a137 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:39.878008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:39.963552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988bdc8-64d3-40fc-aee3-0ac73cd3a137 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:39.997195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:39.997800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:39.998082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:39.998382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:39.999045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:39.999350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:40.001544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:40.003192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:40.009918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 26/52] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:40.016223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:40.095959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:40.107227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f2668-3cd1-4709-a736-cffce15f7070 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:40.119178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d06283-5b50-4c8a-bc50-5cc799326e60 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:40.133045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:40.141917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:40.142588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:40.142875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:40.143150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:40.144269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:40.145728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:40.147336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:40.152748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:40.153238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:40.153875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:40.154191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:40.154470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] PATH_INFO: `/v3/users/4da2a13608794bc8b00af153bd2654b1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:40.155809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] RBAC: Authorizing `identity:get_user(user_id=4da2a13608794bc8b00af153bd2654b1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:40.158073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:40.159676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 27/54] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:40 2022] GET /identity/v3/users/4da2a13608794bc8b00af153bd2654b1 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:40.164796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:40.252920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2ed6d-8912-42c9-a6f8-02275d4e5d19 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:40.263704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd87e7-980d-4545-8acc-c315949438b1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:40.286132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44506b-0fa4-42cb-9fca-611cd2822515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:40.286748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44506b-0fa4-42cb-9fca-611cd2822515 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:40.287035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44506b-0fa4-42cb-9fca-611cd2822515 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:40.287304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44506b-0fa4-42cb-9fca-611cd2822515 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:40.287947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44506b-0fa4-42cb-9fca-611cd2822515 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:40.289393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44506b-0fa4-42cb-9fca-611cd2822515 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:40.296949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:40.297564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:40.297843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:40.298140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:40.299283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:40.300765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:40.302433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:40.308512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:40.325449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:40.417236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49858d12-fecf-4719-8e0b-9cc0e118dd53 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:40.421059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 28/56] 10.222.0.52 () {60 vars in 1140 bytes} [Fri Sep 9 14:43:40 2022] POST /identity/v3/projects => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:43:40.454259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d73ce-c8e1-4902-9480-b697d41d00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:40.454893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d73ce-c8e1-4902-9480-b697d41d00d2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:40.455177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d73ce-c8e1-4902-9480-b697d41d00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:40.455717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d73ce-c8e1-4902-9480-b697d41d00d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:40.456464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d73ce-c8e1-4902-9480-b697d41d00d2 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.domain.id=default, user.id=4da2a13608794bc8b00af153bd2654b1) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:40.456774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d73ce-c8e1-4902-9480-b697d41d00d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:40.458293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d73ce-c8e1-4902-9480-b697d41d00d2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:40.464998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1322 bytes} [Fri Sep 9 14:43:40 2022] GET /identity/v3/role_assignments?user.id=4da2a13608794bc8b00af153bd2654b1&scope.domain.id=default&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:42.615525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5856c-650b-4216-a13c-ee37bfecbdb0 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:42.616069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5856c-650b-4216-a13c-ee37bfecbdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:42.616069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5856c-650b-4216-a13c-ee37bfecbdb0 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:42.617462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 29/58] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:42.622846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e653-e9bf-4302-9c29-7cfdb2d4e389 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:42.623233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e653-e9bf-4302-9c29-7cfdb2d4e389 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:42.623404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82e653-e9bf-4302-9c29-7cfdb2d4e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:42.642544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ea82e653-e9bf-4302-9c29-7cfdb2d4e389 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:42.643718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ea82e653-e9bf-4302-9c29-7cfdb2d4e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:42.709613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 30/59] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:42.977876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5856c-650b-4216-a13c-ee37bfecbdb0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:43.027360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:43.077868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5856c-650b-4216-a13c-ee37bfecbdb0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:43.110834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec68c2d-8462-46fc-b2ee-07df3ccad126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:43.111448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec68c2d-8462-46fc-b2ee-07df3ccad126 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:43.111725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec68c2d-8462-46fc-b2ee-07df3ccad126 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:43.111995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec68c2d-8462-46fc-b2ee-07df3ccad126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:43.113085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec68c2d-8462-46fc-b2ee-07df3ccad126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:43.114557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec68c2d-8462-46fc-b2ee-07df3ccad126 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:43.116101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 30/60] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:43.121662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e653-e9bf-4302-9c29-7cfdb2d4e389 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:43.129823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:43.220311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82e653-e9bf-4302-9c29-7cfdb2d4e389 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:43.253650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3623db-c83c-485a-988e-02f6df47c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:43.254223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3623db-c83c-485a-988e-02f6df47c7af None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:43.254509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3623db-c83c-485a-988e-02f6df47c7af None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:43.254785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3623db-c83c-485a-988e-02f6df47c7af None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:43.255430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3623db-c83c-485a-988e-02f6df47c7af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:43.256871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3623db-c83c-485a-988e-02f6df47c7af None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:43.283569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 31/61] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:43:43 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:43:46.600759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e75a0-e8c7-4c06-a0af-afb9229409c0 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:46.601774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e75a0-e8c7-4c06-a0af-afb9229409c0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:46.602287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e75a0-e8c7-4c06-a0af-afb9229409c0 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:46.603866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 31/62] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:46.609353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774028-6290-42b9-bb4a-45f08fd74560 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:46.610247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774028-6290-42b9-bb4a-45f08fd74560 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:46.610729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3774028-6290-42b9-bb4a-45f08fd74560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:46.639205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f3774028-6290-42b9-bb4a-45f08fd74560 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:46.641456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f3774028-6290-42b9-bb4a-45f08fd74560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:46.649714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55baaa-5840-4fe6-bef8-2425c70a4b7d None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:46.650403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55baaa-5840-4fe6-bef8-2425c70a4b7d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:46.650891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55baaa-5840-4fe6-bef8-2425c70a4b7d None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:46.652536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:46.662150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a3d99-1096-4eeb-b1c3-b08fe78ccaf2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:46.662150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a3d99-1096-4eeb-b1c3-b08fe78ccaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:46.662150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a3d99-1096-4eeb-b1c3-b08fe78ccaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:46.697803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ba5a3d99-1096-4eeb-b1c3-b08fe78ccaf2 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:46.699065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ba5a3d99-1096-4eeb-b1c3-b08fe78ccaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:46.764725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:46.786761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 32/64] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:46.788392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3941a1-7de1-4b5a-95bb-9deae6aae7f1 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:46.788873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3941a1-7de1-4b5a-95bb-9deae6aae7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:46.789335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3941a1-7de1-4b5a-95bb-9deae6aae7f1 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:46.794688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 33/65] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:46.796126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ecce9-8721-42b1-9644-6ebc9d50d8ef None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:46.796642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ecce9-8721-42b1-9644-6ebc9d50d8ef None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:46.797355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ecce9-8721-42b1-9644-6ebc9d50d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:46.811795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 33/66] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:46.820328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ad1ecce9-8721-42b1-9644-6ebc9d50d8ef None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:46.821519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ad1ecce9-8721-42b1-9644-6ebc9d50d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:46.904376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 34/67] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:47.173480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371244a-c332-487d-9f57-3ffcafafed10 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.174168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371244a-c332-487d-9f57-3ffcafafed10 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.174659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371244a-c332-487d-9f57-3ffcafafed10 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.176503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 34/68] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:47.181798 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e67af-4607-44bb-ac9b-62e84b270049 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.181941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371244a-c332-487d-9f57-3ffcafafed10 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.182162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e67af-4607-44bb-ac9b-62e84b270049 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.184995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e67af-4607-44bb-ac9b-62e84b270049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.205435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-bf3e67af-4607-44bb-ac9b-62e84b270049 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:47.207253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bf3e67af-4607-44bb-ac9b-62e84b270049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:47.234765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:47.284695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 35/69] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:47.285618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e67af-4607-44bb-ac9b-62e84b270049 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.305674 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371244a-c332-487d-9f57-3ffcafafed10 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.341802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:47.358060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:47.359595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.360069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.360561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.372436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:47.377869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:47.378741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:47.379496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 35/70] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:43:47.380617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.404493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e67af-4607-44bb-ac9b-62e84b270049 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.440098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4a664-a831-4d33-9d3c-b08f060d13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:47.440663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4a664-a831-4d33-9d3c-b08f060d13e4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.440949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4a664-a831-4d33-9d3c-b08f060d13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.441228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4a664-a831-4d33-9d3c-b08f060d13e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.452291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4a664-a831-4d33-9d3c-b08f060d13e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-42d4a664-a831-4d33-9d3c-b08f060d13e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:47.457833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:47.458864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:47.459631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:47.461319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d41d-6ce2-4033-aef1-2f5bfd1b2571 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.461319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d41d-6ce2-4033-aef1-2f5bfd1b2571 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.461509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115d41d-6ce2-4033-aef1-2f5bfd1b2571 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.463783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 37/72] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:47.464261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d41d-6ce2-4033-aef1-2f5bfd1b2571 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.490285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0903c-4f6a-47f0-a37a-60ca67b093b3 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.497868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:47.526568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:47.527201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.527483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.527752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.538620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:47.543367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:47.544299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:47.545063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:47.546175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.578891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115d41d-6ce2-4033-aef1-2f5bfd1b2571 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.593427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:47.615445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790e21c-7a9b-4728-9894-68e3f56a1ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:47.616059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790e21c-7a9b-4728-9894-68e3f56a1ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.616341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790e21c-7a9b-4728-9894-68e3f56a1ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.616619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790e21c-7a9b-4728-9894-68e3f56a1ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.617286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790e21c-7a9b-4728-9894-68e3f56a1ed0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:47.617591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790e21c-7a9b-4728-9894-68e3f56a1ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:47.619012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790e21c-7a9b-4728-9894-68e3f56a1ed0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:47.627453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 38/74] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:47.628609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1829-e162-476c-8e8e-2e746617f32d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.628902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1829-e162-476c-8e8e-2e746617f32d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.629178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1829-e162-476c-8e8e-2e746617f32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.647757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8e4c1829-e162-476c-8e8e-2e746617f32d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:47.647926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6c86c-f3a6-4360-b5e6-b1f73993a793 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.648972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8e4c1829-e162-476c-8e8e-2e746617f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:47.682566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:47.683176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.683455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.683724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.684396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:47.684694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:47.686069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:47.694969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:47.695741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.721294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:47.722151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c1829-e162-476c-8e8e-2e746617f32d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.744036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:47.821687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c1829-e162-476c-8e8e-2e746617f32d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.823284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af23d58-77e8-4699-9a5e-5a08452a9900 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.824001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:47.856987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:47.857624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.857929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.858224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.860164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:47.861622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:47.862505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:47.863374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:47.863472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 40/77] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:47.863962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.867753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:47.868063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:47.868756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:47.869069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:47.870471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:47.879433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 38/78] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:47.880517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:47.976171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6e7e2-34fc-48a8-867e-968f56ff134b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:47.979250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:47.989894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480064b3-438a-46aa-a847-90fb7b9d7c4f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.011355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.011990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.012271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.012540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.023746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.024395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.024669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.024943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] PATH_INFO: `/v3/users/4da2a13608794bc8b00af153bd2654b1` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.026069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] RBAC: Authorizing `identity:get_user(user_id=4da2a13608794bc8b00af153bd2654b1)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.026316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.027528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.027748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.029096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 39/79] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/users/4da2a13608794bc8b00af153bd2654b1 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:48.029365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 41/80] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:47 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:48.031495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.031657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.061618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:48.131327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9f91-258f-49a1-aa03-0e68ed844448 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.134053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e026b8-f451-4152-9135-ccb77fedad96 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.164979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.165606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.165894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.166197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.167306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.167408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.167947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.168231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.168508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.168749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.169153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.170353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 42/81] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:48.170627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.171110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.208458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 40/82] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:43:48 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:43:48.208458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.224557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:48.288629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:48.293350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fd183-f554-4290-9ab7-1580c2b849ae None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.324716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5faa45-d711-411c-af35-6f83d1ba07e9 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.333991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.334997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.335418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.335828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.348476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:48.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:48.355160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:48.356093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:48.358245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 43/83] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:48.359701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.367872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.368492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.368771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.369889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.462819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.464297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.479597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a100-442b-4cc9-977b-472ea3c8b27d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.485032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:48.528140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.528762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.529037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.529306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.565152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:48.612668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.613968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 41/84] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:43:48.614970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.618976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.736530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 44/85] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:43:48.737521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.747581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f71b1-a52a-4ec3-8162-a110c5400b75 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.770110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:48.798229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.798874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.799157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.799431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.817444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:48.865152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721afef-a6be-4c6b-9b9c-12344dc91c08 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:48.877064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.878583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.904366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:48.905412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:48.905887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:48.907237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:48.908063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:48.908685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:48.910542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:48.920837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 45/86] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:48.921726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:48.984956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 42/87] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:43:48.986043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.003694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:49.049066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b9b6f-f612-446f-aec5-3ef800629bfb None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.070534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:49.089626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.090428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.090719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.090997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.092375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.095496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.098032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 46/88] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:49.098672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.114938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078f707-e2c8-4596-be16-2927ea37068e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.152902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.153738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.154143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.154524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.156339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.158039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.159954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 43/89] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:48 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:49.160922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.224166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424b0a9-e0f6-4622-a6c9-2b844742a8b8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.264372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.265010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.265908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.266734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.268539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:49.269253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.271675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.274939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 47/90] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:49 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:49.275482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.290867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8156f-1cc6-4935-9ea0-4dca5a63abae None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.332800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.333402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.333691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.333969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.335130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.336598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.338708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 44/91] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:49 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:49.339685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.359147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:49.414484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f13dc-5cde-4f49-bfc1-755a6ae87722 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.465566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.466695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.467102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.467381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.468105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] RBAC: Adding query filter params (role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=2cc4eaf91022454889475c0da5fbc647) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:49.468591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.469131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd2000-791f-4ce4-b33f-4257ec2255e4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.470868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.477294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 48/92] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:43:49 2022] GET /identity/v3/role_assignments?user.id=2cc4eaf91022454889475c0da5fbc647&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:49.478081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.513065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.513692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.513974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.514274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.515016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=4da2a13608794bc8b00af153bd2654b1) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:49.516104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.517649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.526250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 45/93] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:43:49 2022] GET /identity/v3/role_assignments?user.id=4da2a13608794bc8b00af153bd2654b1&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:49.527023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.545430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:49.614666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5363a3-c0b3-45d6-8ecc-834824fa5766 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.638708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:49.645035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33adbc-9561-47f0-832a-f76685713baa None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:49.657139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.658038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.658353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.658630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.683652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:49.684284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:49.684567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:49.684843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:49.685601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=2cc4eaf91022454889475c0da5fbc647) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:49.685917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.688194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.693847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 46/94] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:43:49 2022] GET /identity/v3/role_assignments?user.id=2cc4eaf91022454889475c0da5fbc647&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:49.744310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:49.745918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:49.868107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 49/95] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:43:49.873666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:49.979487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:50.003501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b560d-e913-4d31-9a66-ae618e7e22e8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:50.045241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6c681-a886-42e7-810e-637a6dcfae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:50.045884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6c681-a886-42e7-810e-637a6dcfae0f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:50.046195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6c681-a886-42e7-810e-637a6dcfae0f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:50.047123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6c681-a886-42e7-810e-637a6dcfae0f None admin] PATH_INFO: `/v3/projects/65f023ad194743e2a6152383d1aabd32` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:50.048281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6c681-a886-42e7-810e-637a6dcfae0f None admin] RBAC: Authorizing `identity:get_project(project_id=65f023ad194743e2a6152383d1aabd32)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:50.049727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6c681-a886-42e7-810e-637a6dcfae0f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:50.051555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 47/96] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:49 2022] GET /identity/v3/projects/65f023ad194743e2a6152383d1aabd32 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:50.057771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:50.081285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:50.165320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999aead-7171-49c6-afce-b3b55727e48a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:50.202146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95729a01-eab6-45e4-a387-c442d6033648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:50.202793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95729a01-eab6-45e4-a387-c442d6033648 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:50.203128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95729a01-eab6-45e4-a387-c442d6033648 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:50.203402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95729a01-eab6-45e4-a387-c442d6033648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:50.204182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95729a01-eab6-45e4-a387-c442d6033648 None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=65f023ad194743e2a6152383d1aabd32, user.id=2cc4eaf91022454889475c0da5fbc647) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:50.204489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95729a01-eab6-45e4-a387-c442d6033648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:50.206232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95729a01-eab6-45e4-a387-c442d6033648 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:50.212598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 50/97] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:43:50 2022] GET /identity/v3/role_assignments?user.id=2cc4eaf91022454889475c0da5fbc647&scope.project.id=65f023ad194743e2a6152383d1aabd32&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:51.009513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea3ce-50d8-4ec7-9138-31d17b393c74 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:51.010030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea3ce-50d8-4ec7-9138-31d17b393c74 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:51.010030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea3ce-50d8-4ec7-9138-31d17b393c74 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:51.011587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 48/98] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:51.017010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db55cb-0483-4948-b996-e5bf2e1f2bd4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:51.017436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db55cb-0483-4948-b996-e5bf2e1f2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:51.017613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db55cb-0483-4948-b996-e5bf2e1f2bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:51.036722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-83db55cb-0483-4948-b996-e5bf2e1f2bd4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:51.037931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-83db55cb-0483-4948-b996-e5bf2e1f2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:51.112148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 51/99] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:51.419109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991bc02-af61-4558-9d2c-66d8ba21107c None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:51.419470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991bc02-af61-4558-9d2c-66d8ba21107c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:51.419668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991bc02-af61-4558-9d2c-66d8ba21107c None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:51.421161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 49/100] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:51.427012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ff13c-cb7c-4e33-bc08-eafb6211e013 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:51.427306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ff13c-cb7c-4e33-bc08-eafb6211e013 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:51.427589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ff13c-cb7c-4e33-bc08-eafb6211e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:51.446217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e26ff13c-cb7c-4e33-bc08-eafb6211e013 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:51.447408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e26ff13c-cb7c-4e33-bc08-eafb6211e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:51.457807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:51.463323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991bc02-af61-4558-9d2c-66d8ba21107c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:51.579442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 52/101] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:51.584722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991bc02-af61-4558-9d2c-66d8ba21107c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:51.620200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:51.620836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:51.621115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:51.621386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:51.632940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:51.637723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:51.639840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:51.641809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 50/102] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:43:51.646077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ff13c-cb7c-4e33-bc08-eafb6211e013 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:51.750194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ff13c-cb7c-4e33-bc08-eafb6211e013 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:51.786121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:51.786741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:51.787019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:51.787293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:51.787960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:51.788263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:51.789702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:51.798800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 53/103] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:43:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:51.804473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:51.813786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:51.933277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4046e5-f1b0-4b6b-b741-ad1f1e135a4e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:51.975953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:51.976503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:51.976777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:51.977046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] PATH_INFO: `/v3/users/37522681ba8648c295f3b5e0feb1fec2` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:51.993113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] RBAC: Authorizing `identity:get_user(user_id=37522681ba8648c295f3b5e0feb1fec2)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:51.994659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:51.996902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 51/104] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:51 2022] GET /identity/v3/users/37522681ba8648c295f3b5e0feb1fec2 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:52.003061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:52.013136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:52.108233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411840a-1265-4a1e-a622-3093940a4f3e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:52.119451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:52.173329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:52.174283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:52.174706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:52.175731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:52.232424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:52.303529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:52.305880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:52.310486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c884dd9-3396-438c-adc5-a37a92ce50cd None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:52.326435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:52.368970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:52.369967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:52.370465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:52.370960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:52.373116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:52.375379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:52.377673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 52/105] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:43:52.383364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:52.526885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd80a2c-0cb6-494c-9bb5-9a14a1ed13d8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:52.543994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 54/106] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:43:52.550543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:52.582234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:52.592187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fff98-fdd7-46f8-9c80-35c641481611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:52.592804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fff98-fdd7-46f8-9c80-35c641481611 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:52.593083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fff98-fdd7-46f8-9c80-35c641481611 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:52.593964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fff98-fdd7-46f8-9c80-35c641481611 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:52.594829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fff98-fdd7-46f8-9c80-35c641481611 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:52.598607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fff98-fdd7-46f8-9c80-35c641481611 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:52.651607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 53/107] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:43:52 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:43:52.686431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007dc6-432d-4c19-9a65-8c8676949ae0 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:52.686727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007dc6-432d-4c19-9a65-8c8676949ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:52.687127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007dc6-432d-4c19-9a65-8c8676949ae0 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:52.689322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 54/108] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:52.708903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8e53b-f1fa-44c6-8a34-375f34505944 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:52.709189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8e53b-f1fa-44c6-8a34-375f34505944 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:52.709467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8e53b-f1fa-44c6-8a34-375f34505944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:52.757959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d8fb0-653a-4afc-9176-31da743f9d88 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:52.759353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d2c8e53b-f1fa-44c6-8a34-375f34505944 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:52.760569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d2c8e53b-f1fa-44c6-8a34-375f34505944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:52.778882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:52.858800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:52.860102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:52.860380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:52.860649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:52.862333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:52.863801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:52.865654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 55/109] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:52 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:52.871378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:52.959187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 55/110] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:53.056957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a1ed-7278-473f-8f45-22d776fbe754 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.057239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a1ed-7278-473f-8f45-22d776fbe754 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.057436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a1ed-7278-473f-8f45-22d776fbe754 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.058837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 56/111] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:53.060019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f8b0e-11af-40a4-a2f1-bbae61e93f92 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:53.067595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea6704-1ac9-46fb-a3d1-6f8e6c47cc9a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.067896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea6704-1ac9-46fb-a3d1-6f8e6c47cc9a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.068144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea6704-1ac9-46fb-a3d1-6f8e6c47cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.106561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b5ea6704-1ac9-46fb-a3d1-6f8e6c47cc9a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:53.107782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b5ea6704-1ac9-46fb-a3d1-6f8e6c47cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:53.111744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91596c56-d56d-47ad-9da7-624c233a6f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:53.112367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596c56-d56d-47ad-9da7-624c233a6f68 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.112655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596c56-d56d-47ad-9da7-624c233a6f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.112930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91596c56-d56d-47ad-9da7-624c233a6f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.113673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91596c56-d56d-47ad-9da7-624c233a6f68 None admin] RBAC: Adding query filter params (role.id=76d7a4d6a7ae4792a66c9ba23e962577, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=37522681ba8648c295f3b5e0feb1fec2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:53.113982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91596c56-d56d-47ad-9da7-624c233a6f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:53.115573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91596c56-d56d-47ad-9da7-624c233a6f68 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:53.128249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 56/112] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:43:52 2022] GET /identity/v3/role_assignments?user.id=37522681ba8648c295f3b5e0feb1fec2&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=76d7a4d6a7ae4792a66c9ba23e962577 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:53.198037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 57/113] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:53.230208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb25c-62ef-4814-97a2-2df27f32d267 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.230510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb25c-62ef-4814-97a2-2df27f32d267 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.230766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deb25c-62ef-4814-97a2-2df27f32d267 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.232196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 57/114] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:53.239345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6eef6-b824-4888-ade9-65c9768533c1 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.239648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6eef6-b824-4888-ade9-65c9768533c1 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.239910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6eef6-b824-4888-ade9-65c9768533c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.266455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a1a6eef6-b824-4888-ade9-65c9768533c1 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:53.267783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a1a6eef6-b824-4888-ade9-65c9768533c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:53.334998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:53.367245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 58/115] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:53.516198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deb25c-62ef-4814-97a2-2df27f32d267 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:53.570785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:53.617570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6eef6-b824-4888-ade9-65c9768533c1 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:53.692777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deb25c-62ef-4814-97a2-2df27f32d267 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:53.773245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0559e-3163-4828-9b47-e0f0876a3442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:53.773892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0559e-3163-4828-9b47-e0f0876a3442 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.774201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0559e-3163-4828-9b47-e0f0876a3442 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.774481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0559e-3163-4828-9b47-e0f0876a3442 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.777204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6eef6-b824-4888-ade9-65c9768533c1 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:53.798531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0559e-3163-4828-9b47-e0f0876a3442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d6f0559e-3163-4828-9b47-e0f0876a3442 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:53.804583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:53.805614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:43:53.806469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:53.808245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 58/116] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:43:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:53.809543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5eb47-07e0-4f8d-b030-fd468f11b453 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.809971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5eb47-07e0-4f8d-b030-fd468f11b453 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.815398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5eb47-07e0-4f8d-b030-fd468f11b453 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.816916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 59/117] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:53.817770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5eb47-07e0-4f8d-b030-fd468f11b453 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:53.838429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:53.839575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.840022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.840429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.854108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:53.860912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:53.861938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:53.862847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:53.864718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 59/118] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:43:53.865676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:53.914767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:53.936609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:53.942648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5eb47-07e0-4f8d-b030-fd468f11b453 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:53.981027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb98d74-d36d-4726-915b-64c2b2a5fbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:53.981939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb98d74-d36d-4726-915b-64c2b2a5fbdb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:53.982408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb98d74-d36d-4726-915b-64c2b2a5fbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:53.982845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb98d74-d36d-4726-915b-64c2b2a5fbdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:53.996424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb98d74-d36d-4726-915b-64c2b2a5fbdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-2cb98d74-d36d-4726-915b-64c2b2a5fbdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:54.002500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:54.003550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:54.004485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:54.005751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f92bc-e55e-403d-9a18-6bd42faf6cc5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.006683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 60/119] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:54.008058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a4272-c717-4960-a900-a13462e9e371 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.008508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a4272-c717-4960-a900-a13462e9e371 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.008944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a4272-c717-4960-a900-a13462e9e371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.029353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3e6a4272-c717-4960-a900-a13462e9e371 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:54.030940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e6a4272-c717-4960-a900-a13462e9e371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:54.054071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.054721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.055002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.055281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.055957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:54.056952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.058142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.068777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 60/120] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:43:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.074028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.112439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 61/121] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:54.114001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a4272-c717-4960-a900-a13462e9e371 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.185862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:54.194740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685a16b-e1e9-4f86-9686-c40a924d67ec None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.225197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:54.232976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.234262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.234694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.235115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.235950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:54.236398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.237926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.241346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a4272-c717-4960-a900-a13462e9e371 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.247049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 61/122] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.248170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.282267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.282885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.283169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.283442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.284115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:54.284422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.285790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.294569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 62/123] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.295385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.364057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a2970-2907-469e-9c13-7180a3889b6b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.401049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aa8c4-0775-4eec-ab82-e1722869bf7b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.401775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.402739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.403166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.403603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.404926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.406982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.409058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 62/124] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.410036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.440098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:54.441458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.442253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.442398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.442718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] PATH_INFO: `/v3/users/4da2a13608794bc8b00af153bd2654b1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.443933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] RBAC: Authorizing `identity:get_user(user_id=4da2a13608794bc8b00af153bd2654b1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.445405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.447422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 63/125] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/users/4da2a13608794bc8b00af153bd2654b1 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.447783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.469893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:54.525579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a27cc-0652-41da-9261-270b7447219c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.559783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d86d1-ea13-41b8-9182-51a89957af5b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.589992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.590670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.590953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.591229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.592375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.593879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.595502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 63/126] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.596326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.598132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.598778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.599068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.599345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.600872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.602116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.603760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 64/127] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.604572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.715618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:54.717512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:54.728040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4105-86aa-4fee-b4b3-b8402ac7fb16 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.735649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db8b35-f84a-4f51-9564-60fc827e0e73 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.771782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.772565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.772844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.773166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.773603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.774481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.774961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.775702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.777434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.779419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.782189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 64/128] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.783158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.789357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:54.794896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:54.795758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 65/129] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:54.797193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.913956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf909d8-c3dd-481c-ad25-c14b32dff676 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.918531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066424-bef0-4024-9650-7380862fb0a7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:54.956283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.957017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.957302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.957571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23/users/2cc4eaf91022454889475c0da5fbc647/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.959535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:54.959910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] RBAC: Authorizing `identity:create_grant(project_id=3077daafa0204db79297f77f460c5c23, user_id=2cc4eaf91022454889475c0da5fbc647, role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.960620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:54.961096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:54.961363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.961764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:54.963145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:54.964914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:54.967280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 65/130] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:54.968779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:54.989208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 66/131] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:43:54 2022] PUT /identity/v3/projects/3077daafa0204db79297f77f460c5c23/users/2cc4eaf91022454889475c0da5fbc647/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:43:54.990339 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:55.005246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:55.014253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:55.091783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8b0af-0525-49d1-9248-14a5b2ff78d7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:55.132231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:55.132913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.133197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.133478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23/users/4da2a13608794bc8b00af153bd2654b1/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.135596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] RBAC: Authorizing `identity:create_grant(project_id=3077daafa0204db79297f77f460c5c23, user_id=4da2a13608794bc8b00af153bd2654b1, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:55.137077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:55.165238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 66/132] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:43:54 2022] PUT /identity/v3/projects/3077daafa0204db79297f77f460c5c23/users/4da2a13608794bc8b00af153bd2654b1/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:43:55.166356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:55.246813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0e4a8-3374-46cb-9c49-2e8747e29652 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:55.295215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:55.295844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.296129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.296462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.297682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:55.297999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:55.299475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:55.309962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 67/133] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:55.318129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:55.335406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:55.347552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d23455-5c4f-4f0a-a6be-65ee7b2a8e7f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:55.385559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:55.386266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.386609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.386926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23/users/2cc4eaf91022454889475c0da5fbc647/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.388898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] RBAC: Authorizing `identity:create_grant(project_id=3077daafa0204db79297f77f460c5c23, user_id=2cc4eaf91022454889475c0da5fbc647, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:55.391177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:55.407093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 67/134] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:43:55 2022] PUT /identity/v3/projects/3077daafa0204db79297f77f460c5c23/users/2cc4eaf91022454889475c0da5fbc647/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:43:55.422949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:55.463540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e82274-c8eb-46d3-9bdc-ab0db0b11c43 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:55.502260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040c71-413e-420e-a556-2a7bba4ef892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:55.502888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040c71-413e-420e-a556-2a7bba4ef892 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.503177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040c71-413e-420e-a556-2a7bba4ef892 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.503455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040c71-413e-420e-a556-2a7bba4ef892 None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.504646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76040c71-413e-420e-a556-2a7bba4ef892 None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:55.506170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76040c71-413e-420e-a556-2a7bba4ef892 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:55.508138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 68/135] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:55 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:55.514140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:55.582995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116253c5-d14b-43c6-964a-77430952e667 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.583322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116253c5-d14b-43c6-964a-77430952e667 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.583558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116253c5-d14b-43c6-964a-77430952e667 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.585083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 69/136] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:55.591531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c852-7ee7-43ae-b735-f0b2121786e2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.591840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c852-7ee7-43ae-b735-f0b2121786e2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.592679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074c852-7ee7-43ae-b735-f0b2121786e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.617444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b074c852-7ee7-43ae-b735-f0b2121786e2 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:55.619295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b074c852-7ee7-43ae-b735-f0b2121786e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:55.690866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbffdf5-133d-48e2-a0bb-e7601b48a028 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:55.731711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:55.732356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.732794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.733080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] PATH_INFO: `/v3/projects/65f023ad194743e2a6152383d1aabd32` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.735293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] RBAC: Authorizing `identity:get_project(project_id=65f023ad194743e2a6152383d1aabd32)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:55.738450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:55.740188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 68/137] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:55 2022] GET /identity/v3/projects/65f023ad194743e2a6152383d1aabd32 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:55.742369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 70/138] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:55.750572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:55.777635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:55.880627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaabb8-1416-4f33-b17e-6cccc93b37a0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:55.925123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:55.925794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:55.926074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:55.926379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] PATH_INFO: `/v3/projects/65f023ad194743e2a6152383d1aabd32/users/2cc4eaf91022454889475c0da5fbc647/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:55.931436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] RBAC: Authorizing `identity:create_grant(project_id=65f023ad194743e2a6152383d1aabd32, user_id=2cc4eaf91022454889475c0da5fbc647, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:55.932886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:55.951648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 69/139] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:43:55 2022] PUT /identity/v3/projects/65f023ad194743e2a6152383d1aabd32/users/2cc4eaf91022454889475c0da5fbc647/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:43:56.160005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c852-7ee7-43ae-b735-f0b2121786e2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:56.241830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:56.283540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074c852-7ee7-43ae-b735-f0b2121786e2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:56.326117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a81b63-68b0-4ff6-a39d-c5ed859be9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:56.326740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81b63-68b0-4ff6-a39d-c5ed859be9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:56.327013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81b63-68b0-4ff6-a39d-c5ed859be9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:56.327282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a81b63-68b0-4ff6-a39d-c5ed859be9d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:56.335140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81b63-68b0-4ff6-a39d-c5ed859be9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:56.336660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a81b63-68b0-4ff6-a39d-c5ed859be9d4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:56.339059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 71/140] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:56.345571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:56.376948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3b9e6-0e59-4b3f-b328-2e03e8646216 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:56.377296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3b9e6-0e59-4b3f-b328-2e03e8646216 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:56.377486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3b9e6-0e59-4b3f-b328-2e03e8646216 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:56.378850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 72/141] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:56.383779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106f79-f589-430b-8bbf-6c02383a651a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:56.384058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106f79-f589-430b-8bbf-6c02383a651a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:56.384331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106f79-f589-430b-8bbf-6c02383a651a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:56.406312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ac106f79-f589-430b-8bbf-6c02383a651a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:56.407671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ac106f79-f589-430b-8bbf-6c02383a651a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:56.464142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:56.505641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e21e1-bbaa-4f7a-9c50-f38850f9d760 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:56.527560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 73/142] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:56.560500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:56.561121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:56.561405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:56.561678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:56.562408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:56.563877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:56.591700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 70/143] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:43:56 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:43:57.025168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106f79-f589-430b-8bbf-6c02383a651a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:57.098325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:57.143944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106f79-f589-430b-8bbf-6c02383a651a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:57.186791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:57.188009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:57.188285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:57.188559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:57.199186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:57.204035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:57.204854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:43:57.205604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 74/144] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:57.211188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:57.335139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb8d8-9785-4101-a1b4-ddad04ba02e4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:57.383924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:57.384529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:57.384810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:57.385086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:57.385760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:57.386064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:57.387465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:57.388809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:57.399995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 71/145] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:43:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:57.405520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:57.521389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04df1c-e4ba-473f-b4b5-843a9401554d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:57.550802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:57.563506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:57.564389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:57.564840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:57.565310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] PATH_INFO: `/v3/users/37522681ba8648c295f3b5e0feb1fec2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:57.566662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] RBAC: Authorizing `identity:get_user(user_id=37522681ba8648c295f3b5e0feb1fec2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:57.568294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:57.570125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 75/146] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:57 2022] GET /identity/v3/users/37522681ba8648c295f3b5e0feb1fec2 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:57.575900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:57.693036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837b9f-8804-4525-8ab1-5aed41a063f0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:57.735030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095da77-56cb-4176-91f4-504dda066034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:57.735675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095da77-56cb-4176-91f4-504dda066034 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:57.736017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095da77-56cb-4176-91f4-504dda066034 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:57.736344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095da77-56cb-4176-91f4-504dda066034 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:57.740556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095da77-56cb-4176-91f4-504dda066034 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:57.742150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095da77-56cb-4176-91f4-504dda066034 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:57.743906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 72/147] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:43:57 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:57.749660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:57.861942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ac24a-a53e-4de7-9eb8-ad1586b25f80 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:57.901495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abd9d1-d6ee-44b8-bee1-3fcd10aaabee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:57.902185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abd9d1-d6ee-44b8-bee1-3fcd10aaabee None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:57.902519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abd9d1-d6ee-44b8-bee1-3fcd10aaabee None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:57.902793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abd9d1-d6ee-44b8-bee1-3fcd10aaabee None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23/users/37522681ba8648c295f3b5e0feb1fec2/roles/76d7a4d6a7ae4792a66c9ba23e962577` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:57.904742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abd9d1-d6ee-44b8-bee1-3fcd10aaabee None admin] RBAC: Authorizing `identity:create_grant(project_id=3077daafa0204db79297f77f460c5c23, user_id=37522681ba8648c295f3b5e0feb1fec2, role_id=76d7a4d6a7ae4792a66c9ba23e962577)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:57.906895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9abd9d1-d6ee-44b8-bee1-3fcd10aaabee None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:57.925049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 76/148] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:43:57 2022] PUT /identity/v3/projects/3077daafa0204db79297f77f460c5c23/users/37522681ba8648c295f3b5e0feb1fec2/roles/76d7a4d6a7ae4792a66c9ba23e962577 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:43:58.226537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2ad5d-aaa4-4c45-849f-53888f475701 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:58.226828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2ad5d-aaa4-4c45-849f-53888f475701 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:58.227108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2ad5d-aaa4-4c45-849f-53888f475701 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:58.228762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 73/149] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:58.234848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440231c9-7721-49ec-8462-82c1001e66b6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:58.235142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440231c9-7721-49ec-8462-82c1001e66b6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:58.235397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440231c9-7721-49ec-8462-82c1001e66b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:58.259403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-440231c9-7721-49ec-8462-82c1001e66b6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:58.260672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-440231c9-7721-49ec-8462-82c1001e66b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:58.326551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:58.356799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 77/150] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:43:58.805844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2ad5d-aaa4-4c45-849f-53888f475701 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:58.835935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd13e-f663-4eee-8289-48be64f8df5d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:58.836785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd13e-f663-4eee-8289-48be64f8df5d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:58.837199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd13e-f663-4eee-8289-48be64f8df5d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:58.838724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 78/151] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:43:58.844788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ae74-52ea-4f20-b778-eea4bca1d84b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:58.845321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ae74-52ea-4f20-b778-eea4bca1d84b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:58.845740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ae74-52ea-4f20-b778-eea4bca1d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:58.879223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ece6ae74-52ea-4f20-b778-eea4bca1d84b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:58.882225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ece6ae74-52ea-4f20-b778-eea4bca1d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:58.918588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:58.989556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2ad5d-aaa4-4c45-849f-53888f475701 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:59.032606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 79/152] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:59.034200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2888ed3-535f-40bb-bd83-8940d903f8ed None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:59.034585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2888ed3-535f-40bb-bd83-8940d903f8ed None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:59.034957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2888ed3-535f-40bb-bd83-8940d903f8ed None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:59.042933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 80/153] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:43:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:43:59.058025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf28e-7d6c-4329-8b5b-09e9290ff826 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:59.058486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf28e-7d6c-4329-8b5b-09e9290ff826 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:59.058859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf28e-7d6c-4329-8b5b-09e9290ff826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:59.070975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:59.072723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:59.073186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:59.073613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:59.092527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:59.092961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4b0cf28e-7d6c-4329-8b5b-09e9290ff826 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:43:59.095074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4b0cf28e-7d6c-4329-8b5b-09e9290ff826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:59.100276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:59.101407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:43:59.102377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:59.110363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 74/154] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:43:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:43:59.111426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:59.243084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573838-763a-4ee4-a2f6-3354f43ee16f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:59.247483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 81/155] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:43:59.269168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:59.289503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:59.290392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:59.290824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:59.291246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:59.292127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:43:59.292575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:59.294106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:59.303184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 75/156] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:43:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:59.309145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf28e-7d6c-4329-8b5b-09e9290ff826 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:59.393975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:59.470805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf28e-7d6c-4329-8b5b-09e9290ff826 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:59.481612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:59.538178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:59.539228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:59.539741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:59.540204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:59.541525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:43:59.543261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:43:59.545439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 82/157] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:43:59 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:43:59.561757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:59.698231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c054a8-c1fa-45f6-9a4a-290bc5e9225e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:59.759689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf002e5-80af-4e5d-bf5b-63710edfc0ef None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:43:59.779902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:43:59.795613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:59.796192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:59.797127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:59.797486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:59.831313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:43:59.837338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:43:59.838317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:43:59.839113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 76/158] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:43:59.846342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:43:59.851341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:43:59.851966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:43:59.852241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:43:59.852513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:43:59.962444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:00.019539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:00.021023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:00.090261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557b06-195b-46b3-b6a3-e80b358168af None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:00.167973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:00.168583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.168856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.169123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.169820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:00.170100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:00.172020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:00.191624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 77/159] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:00.192282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:00.242910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 83/160] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:43:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 14:44:00.246614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:00.266236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:00.311259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ebe7-43ba-40af-b0b4-bc299af62061 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:00.341718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:00.362571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:00.363297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.363582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.363859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.387293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:00.393354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:00.394261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:00.395085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:00.398758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 78/161] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:00.399389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:00.499381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576de39-6e5b-4935-9cc0-df272db09a1e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:00.564153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4861c1-7aa4-4eab-8228-ec002431f47b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:00.580264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb053-a582-4dde-9c3f-4f77e0cd9d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:00.580903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb053-a582-4dde-9c3f-4f77e0cd9d39 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.581438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb053-a582-4dde-9c3f-4f77e0cd9d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.581711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb053-a582-4dde-9c3f-4f77e0cd9d39 None admin] PATH_INFO: `/v3/users/4da2a13608794bc8b00af153bd2654b1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.586771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb053-a582-4dde-9c3f-4f77e0cd9d39 None admin] RBAC: Authorizing `identity:get_user(user_id=4da2a13608794bc8b00af153bd2654b1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:00.588249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb053-a582-4dde-9c3f-4f77e0cd9d39 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:00.590016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 84/162] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:00 2022] GET /identity/v3/users/4da2a13608794bc8b00af153bd2654b1 => generated 247 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:00.591034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367f77-ce8f-4233-9dc1-48d7fb828768 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.591313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367f77-ce8f-4233-9dc1-48d7fb828768 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.591587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367f77-ce8f-4233-9dc1-48d7fb828768 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.592970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 85/163] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:00.593707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367f77-ce8f-4233-9dc1-48d7fb828768 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:00.606743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:00.607375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.607650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.607917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.609086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:00.611025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:00.612790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 79/164] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:00 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:00.613427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:00.649726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:00.793099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:00.800239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345948f-0922-4de9-9220-1d93edd9d270 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:00.846179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367f77-ce8f-4233-9dc1-48d7fb828768 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:00.867591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:00.868241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.868526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.868801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.912304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66f76c-6555-44a7-b46d-4d4ef9f89498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:00.913024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66f76c-6555-44a7-b46d-4d4ef9f89498 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.913235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66f76c-6555-44a7-b46d-4d4ef9f89498 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.913500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66f76c-6555-44a7-b46d-4d4ef9f89498 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.914195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66f76c-6555-44a7-b46d-4d4ef9f89498 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:00.914498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66f76c-6555-44a7-b46d-4d4ef9f89498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:00.915877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66f76c-6555-44a7-b46d-4d4ef9f89498 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:00.938423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 86/165] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:00.939753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e535-0faf-4f47-9420-9b3e158b567e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:00.940041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e535-0faf-4f47-9420-9b3e158b567e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:00.940389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773e535-0faf-4f47-9420-9b3e158b567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:00.970436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7773e535-0faf-4f47-9420-9b3e158b567e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:00.971743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7773e535-0faf-4f47-9420-9b3e158b567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:00.972855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:00.974825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:01.015425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:01.105428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 87/166] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:01.106754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773e535-0faf-4f47-9420-9b3e158b567e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:01.122868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 80/167] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:01.124747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:01.246530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:01.297515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773e535-0faf-4f47-9420-9b3e158b567e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:01.301632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751025d4-2931-48b0-8609-cbaa0e5b8ebb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:01.352806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:01.353797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:01.354321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:01.354901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:01.356495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:01.358159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:01.359772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:01.361069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:01.361517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:01.361921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:01.362845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] RBAC: Adding query filter params (role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=2cc4eaf91022454889475c0da5fbc647) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:01.363301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:01.364864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:01.366996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 81/168] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:01 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:01.368074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:01.377832 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:01.382226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 88/169] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:01 2022] GET /identity/v3/role_assignments?user.id=2cc4eaf91022454889475c0da5fbc647&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:01.383246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:01.535682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859995b-7af5-40bf-890c-7d50620080ec None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:01.588500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e035aed-f2d4-4658-81f7-af6fc974bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:01.589544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035aed-f2d4-4658-81f7-af6fc974bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:01.590082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035aed-f2d4-4658-81f7-af6fc974bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:01.590595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035aed-f2d4-4658-81f7-af6fc974bfc0 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:01.592070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e035aed-f2d4-4658-81f7-af6fc974bfc0 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:01.602748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e035aed-f2d4-4658-81f7-af6fc974bfc0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:01.604986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 82/170] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:01 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:01.606608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680d141-c4d0-42a3-8fd3-dd83686408b7 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:01.607120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680d141-c4d0-42a3-8fd3-dd83686408b7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:01.607601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680d141-c4d0-42a3-8fd3-dd83686408b7 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:01.609369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 83/171] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:01.611540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680d141-c4d0-42a3-8fd3-dd83686408b7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:01.616321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86f858-93d3-4a12-854e-1e466d2c641f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:01.671630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:01.672379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:01.672910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:01.673190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:01.685393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:01.747515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:01.802945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:01.804747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:01.837493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680d141-c4d0-42a3-8fd3-dd83686408b7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:01.907619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276f03e-c3a2-4cbc-969e-02994edcd658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:01.909063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276f03e-c3a2-4cbc-969e-02994edcd658 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:01.909557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276f03e-c3a2-4cbc-969e-02994edcd658 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:01.910223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276f03e-c3a2-4cbc-969e-02994edcd658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:01.911158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276f03e-c3a2-4cbc-969e-02994edcd658 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=4da2a13608794bc8b00af153bd2654b1) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:01.911668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276f03e-c3a2-4cbc-969e-02994edcd658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:01.913529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276f03e-c3a2-4cbc-969e-02994edcd658 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:01.920438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 84/172] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:01 2022] GET /identity/v3/role_assignments?user.id=4da2a13608794bc8b00af153bd2654b1&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:01.922197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7508f1-48c5-412e-9b36-aa3889af5dc4 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:01.922686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7508f1-48c5-412e-9b36-aa3889af5dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:01.923175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7508f1-48c5-412e-9b36-aa3889af5dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:01.945993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 89/173] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:01.949105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:01.956977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2c7508f1-48c5-412e-9b36-aa3889af5dc4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:01.958589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2c7508f1-48c5-412e-9b36-aa3889af5dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:02.017093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:02.113689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 85/174] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:02.117047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6052-6ab2-494c-aded-264b4d26da60 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.117542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6052-6ab2-494c-aded-264b4d26da60 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.118938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d6052-6ab2-494c-aded-264b4d26da60 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.121373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 86/175] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:02.123696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6052-6ab2-494c-aded-264b4d26da60 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:02.154223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074283-99af-49ea-a112-b375265fafc2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:02.209395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4361da1-552f-47a1-945e-59c689fc252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:02.209952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4361da1-552f-47a1-945e-59c689fc252f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.210262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4361da1-552f-47a1-945e-59c689fc252f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.210536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4361da1-552f-47a1-945e-59c689fc252f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.229771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4361da1-552f-47a1-945e-59c689fc252f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:02.231954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d4361da1-552f-47a1-945e-59c689fc252f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:02.237711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:02.238858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:02.239715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:02.242827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 90/176] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:02.244161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583caec-3dcf-4d43-a9f6-2bad048113f4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.244582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583caec-3dcf-4d43-a9f6-2bad048113f4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.245007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583caec-3dcf-4d43-a9f6-2bad048113f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.269380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d583caec-3dcf-4d43-a9f6-2bad048113f4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:02.270802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d583caec-3dcf-4d43-a9f6-2bad048113f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:02.305202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d6052-6ab2-494c-aded-264b4d26da60 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:02.366013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9f69e-cf92-4f82-94dc-1c5a3eb8514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:02.366672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f69e-cf92-4f82-94dc-1c5a3eb8514a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.366946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f69e-cf92-4f82-94dc-1c5a3eb8514a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.367210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9f69e-cf92-4f82-94dc-1c5a3eb8514a None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.368547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9f69e-cf92-4f82-94dc-1c5a3eb8514a None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:02.369995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9f69e-cf92-4f82-94dc-1c5a3eb8514a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:02.371650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 87/177] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:02.372818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7abfc-3e98-4d11-8a3b-0938730aa198 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.373045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7abfc-3e98-4d11-8a3b-0938730aa198 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.373161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 91/178] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:02.373348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7abfc-3e98-4d11-8a3b-0938730aa198 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.373963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583caec-3dcf-4d43-a9f6-2bad048113f4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:02.378205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 88/179] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:02.379008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7abfc-3e98-4d11-8a3b-0938730aa198 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:02.404980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:02.495213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583caec-3dcf-4d43-a9f6-2bad048113f4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:02.521407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7abfc-3e98-4d11-8a3b-0938730aa198 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:02.532006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6377-0ab7-4480-9fb4-6e1883f7a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:02.532611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6377-0ab7-4480-9fb4-6e1883f7a2fb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.532887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6377-0ab7-4480-9fb4-6e1883f7a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.533157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6377-0ab7-4480-9fb4-6e1883f7a2fb None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.533815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6377-0ab7-4480-9fb4-6e1883f7a2fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:02.534135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6377-0ab7-4480-9fb4-6e1883f7a2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:02.535502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc6377-0ab7-4480-9fb4-6e1883f7a2fb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:02.544233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 92/180] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:02.545374 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c64788-1d1d-4dcf-9de9-6ee2f44e5a56 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.545655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c64788-1d1d-4dcf-9de9-6ee2f44e5a56 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.545924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c64788-1d1d-4dcf-9de9-6ee2f44e5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.561120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:02.561722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.562550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.562898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.563710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=2cc4eaf91022454889475c0da5fbc647) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:02.564010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e5c64788-1d1d-4dcf-9de9-6ee2f44e5a56 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:02.564117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:02.565178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e5c64788-1d1d-4dcf-9de9-6ee2f44e5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:02.565445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:02.567510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:02.582462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 89/181] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/role_assignments?user.id=2cc4eaf91022454889475c0da5fbc647&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:02.583359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:02.642993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 93/182] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:02.643824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31b2c-8c25-4924-bf8a-6cc3733e1711 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.644107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31b2c-8c25-4924-bf8a-6cc3733e1711 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.644378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb31b2c-8c25-4924-bf8a-6cc3733e1711 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.645619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 94/183] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:02.646368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb31b2c-8c25-4924-bf8a-6cc3733e1711 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:02.665953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:02.729238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf290d-c7a7-4ab4-82a7-6e51b256d20f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:02.773892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb31b2c-8c25-4924-bf8a-6cc3733e1711 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:02.778424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40989137-0bff-4ae2-86b8-4239c2c46170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:02.779265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40989137-0bff-4ae2-86b8-4239c2c46170 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.779688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40989137-0bff-4ae2-86b8-4239c2c46170 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.780099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40989137-0bff-4ae2-86b8-4239c2c46170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.793888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40989137-0bff-4ae2-86b8-4239c2c46170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-40989137-0bff-4ae2-86b8-4239c2c46170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:02.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:02.802007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:02.802858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:02.803448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 90/184] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:02.804497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131fea-7e23-41e3-9dca-55232e14b909 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.805426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131fea-7e23-41e3-9dca-55232e14b909 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.805426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a131fea-7e23-41e3-9dca-55232e14b909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.824748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:02.825399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.825660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.825928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] PATH_INFO: `/v3/users/2cc4eaf91022454889475c0da5fbc647` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.827091 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] RBAC: Authorizing `identity:get_user(user_id=2cc4eaf91022454889475c0da5fbc647)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:02.828814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:02.830540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 95/185] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/users/2cc4eaf91022454889475c0da5fbc647 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:02.831522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1a131fea-7e23-41e3-9dca-55232e14b909 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:02.831638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:02.833136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1a131fea-7e23-41e3-9dca-55232e14b909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:02.889852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:02.907852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 91/186] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:02.910270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a131fea-7e23-41e3-9dca-55232e14b909 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:02.926338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:02.943919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2a5f3-9a7b-496f-8d18-da78172aed0d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:02.979675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:02.980334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:02.980577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:02.980851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:02.991544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:02.996371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:02.997234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:02.998116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 96/187] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:02.998786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.032843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a131fea-7e23-41e3-9dca-55232e14b909 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.068872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.069471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.069755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.070007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.070689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:03.071053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.072407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.080773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 92/188] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:03.081650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.111081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ef8e5-8d8c-4a9e-8ed7-6b4055dd5c3e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.132268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.148807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.149472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.149753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.150021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.165649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.186310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece0d0-09a2-4516-9d50-780f5dca12bc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.220478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.221309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.221931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.222046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.222313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.222578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.223669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.225078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.226659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 93/189] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:03.231212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.320949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 97/190] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:03.322029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.326205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80a01c-3cf4-4f71-9850-5b3000b39ac6 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.344810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.361946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.362582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.362863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.363130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.363783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:03.364083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.365445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.367061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.373503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 94/191] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:03.379408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.421678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85da61-a89e-4b7e-a190-223748eb6d40 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.455447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.456320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.456597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.456956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] PATH_INFO: `/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.470153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] RBAC: Authorizing `identity:get_user(user_id=ba61ed5f0a97494aad3242d5ee5e77d4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.471604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.473217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 98/192] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:03.477870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0f36c-8d40-4569-8294-276df373b23d None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.478553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.512309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.512926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.513196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.513459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.524377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:03.529626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:03.530662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 95/193] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:03.531588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.572675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.578284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8144d9-2dbc-458b-88fb-dc56110b0999 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.579795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.615318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.615923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.616204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.616473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.617118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.618595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.632792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8fd29-0153-40ff-a97e-8ad98501efc5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.641457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 99/194] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:03 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:44:03.642176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.672413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.673565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.673847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.674144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] PATH_INFO: `/v3/projects/65f023ad194743e2a6152383d1aabd32` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.675376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] RBAC: Authorizing `identity:get_project(project_id=65f023ad194743e2a6152383d1aabd32)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.677121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.683923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 96/195] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/projects/65f023ad194743e2a6152383d1aabd32 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:03.683923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.764810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498e6a0-47d6-432e-942a-96df3ad5102b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.801059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4357de4-427a-48fe-b4eb-b4c5bc32e528 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.806416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.807061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.807342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.807613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] PATH_INFO: `/v3/users/37522681ba8648c295f3b5e0feb1fec2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.809833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] RBAC: Authorizing `identity:get_user(user_id=37522681ba8648c295f3b5e0feb1fec2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.810666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.811084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.813844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 100/196] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/users/37522681ba8648c295f3b5e0feb1fec2 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:03.814981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:03.842424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.843504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.843806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.844102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.850738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:03.932828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.934357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.939748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdb386-c3b2-4cf7-99e9-ae01b30fc94a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:03.981490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:03.982274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:03.982516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:03.982793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:03.983470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:03.984297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:03.985689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:03.995482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 101/197] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:03.996445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.065231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 97/198] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:04.067114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.083152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:04.121526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:04.139171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4dc84-00a8-418d-813d-4b192c681dc0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:04.183577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66f38a-a763-4e50-a4d3-66a257e324c4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:04.186035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d887c-8759-4113-9891-54b756988182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:04.188290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d887c-8759-4113-9891-54b756988182 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:04.188716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d887c-8759-4113-9891-54b756988182 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:04.189143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d887c-8759-4113-9891-54b756988182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:04.190020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d887c-8759-4113-9891-54b756988182 None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=65f023ad194743e2a6152383d1aabd32, user.id=2cc4eaf91022454889475c0da5fbc647) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:04.190486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d887c-8759-4113-9891-54b756988182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:04.192052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d887c-8759-4113-9891-54b756988182 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:04.200029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 102/199] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:03 2022] GET /identity/v3/role_assignments?user.id=2cc4eaf91022454889475c0da5fbc647&scope.project.id=65f023ad194743e2a6152383d1aabd32&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:04.201185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d887c-8759-4113-9891-54b756988182 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.227330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:04.228166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:04.228696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:04.229007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:04.317922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:04.319688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:04.334947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:04.367011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d887c-8759-4113-9891-54b756988182 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:04.440241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:04.440891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:04.441165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:04.441435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] PATH_INFO: `/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:04.444226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] RBAC: Authorizing `identity:get_user(user_id=ba61ed5f0a97494aad3242d5ee5e77d4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:04.445715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:04.447413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 103/200] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:04 2022] GET /identity/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:04.448270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.480480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:04.509429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 98/201] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:04.511094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.591160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15905-39ed-452b-96c5-540ffd164c09 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:04.631466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:04.632287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:04.632395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:04.632641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:04.633823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:04.636848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:04.642112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 104/202] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:04 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:04.642112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.653393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9da3a9-c773-48e3-b985-ff7bc84d963b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:04.666338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:04.705413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:04.706949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:04.707737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:04.709210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:04.789911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:04.806915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114532cd-7496-4157-8fc4-a08fc1d76eaa None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:04.833101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:04.834960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:04.867423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:04.868061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:04.868342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:04.868613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:04.872871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:04.875392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:04.877235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 105/203] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:04 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:04.877791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.980338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 99/204] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:04.981827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:04.995737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:05.059078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda20723-e5f8-4cf1-9fe9-9d6738776cd3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:05.131011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:05.131011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:05.131011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:05.131011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:05.134502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=ba61ed5f0a97494aad3242d5ee5e77d4) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:05.135814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:05.139450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:05.142519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42abde8-49cd-4dc1-a28b-bd584d9424a8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:05.148126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 106/205] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:04 2022] GET /identity/v3/role_assignments?user.id=ba61ed5f0a97494aad3242d5ee5e77d4&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:05.149366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:05.201051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:05.201678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:05.201957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:05.206328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:05.206328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] RBAC: Adding query filter params (role.id=76d7a4d6a7ae4792a66c9ba23e962577, scope.project.id=3077daafa0204db79297f77f460c5c23, user.id=37522681ba8648c295f3b5e0feb1fec2) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:05.206328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:05.210504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:05.211887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:05.229045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 100/206] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:04 2022] GET /identity/v3/role_assignments?user.id=37522681ba8648c295f3b5e0feb1fec2&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=76d7a4d6a7ae4792a66c9ba23e962577 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:05.365045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f36bc0-0684-4926-9aee-c3adf0fb9dce None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:05.432352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3375c-401d-4031-8509-870d691dbe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:05.432999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3375c-401d-4031-8509-870d691dbe44 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:05.433280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3375c-401d-4031-8509-870d691dbe44 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:05.433553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3375c-401d-4031-8509-870d691dbe44 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:05.434705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3375c-401d-4031-8509-870d691dbe44 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:05.436154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3375c-401d-4031-8509-870d691dbe44 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:05.438391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 107/207] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:05 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:05.444445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:05.600843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:05.635089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e36c-1d48-4dcf-bfd9-a487b9b2c24a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:05.671450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac53eb2-9976-4e57-8261-25701e159ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:05.672069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53eb2-9976-4e57-8261-25701e159ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:05.672348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53eb2-9976-4e57-8261-25701e159ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:05.672622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac53eb2-9976-4e57-8261-25701e159ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:05.673350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53eb2-9976-4e57-8261-25701e159ac3 None admin] RBAC: Adding query filter params (role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=ba61ed5f0a97494aad3242d5ee5e77d4) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:05.673657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53eb2-9976-4e57-8261-25701e159ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:05.675120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac53eb2-9976-4e57-8261-25701e159ac3 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:05.681786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 101/208] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:05 2022] GET /identity/v3/role_assignments?user.id=ba61ed5f0a97494aad3242d5ee5e77d4&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:06.226450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b391b5-4c31-4a2d-86b8-13292cca5aa8 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.226993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b391b5-4c31-4a2d-86b8-13292cca5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.226993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b391b5-4c31-4a2d-86b8-13292cca5aa8 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.228655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 108/209] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:06.234601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405718f-1d5b-407b-a269-ad5c5bafb7b6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.234992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405718f-1d5b-407b-a269-ad5c5bafb7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.235185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405718f-1d5b-407b-a269-ad5c5bafb7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.243167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04623b-8f15-4e6e-85cd-a474fcd74031 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.243716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04623b-8f15-4e6e-85cd-a474fcd74031 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.244186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04623b-8f15-4e6e-85cd-a474fcd74031 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.245694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 109/210] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:06.251507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f74f-1034-4c4a-917a-59883acdd9fc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.252039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f74f-1034-4c4a-917a-59883acdd9fc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.252549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f74f-1034-4c4a-917a-59883acdd9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.255472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b405718f-1d5b-407b-a269-ad5c5bafb7b6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:06.256892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b405718f-1d5b-407b-a269-ad5c5bafb7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:06.271409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-15a9f74f-1034-4c4a-917a-59883acdd9fc None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:06.272903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-15a9f74f-1034-4c4a-917a-59883acdd9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:06.342524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 102/211] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:06.350644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 110/212] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:06.611329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405718f-1d5b-407b-a269-ad5c5bafb7b6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:06.625333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f74f-1034-4c4a-917a-59883acdd9fc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:06.649373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:06.678077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:06.723297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405718f-1d5b-407b-a269-ad5c5bafb7b6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:06.752654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f74f-1034-4c4a-917a-59883acdd9fc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:06.762919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:06.763772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.764502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.765583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.766994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:06.769341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:06.771612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 103/213] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:06.776855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:06.796852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:06.797498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.797780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.798053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.811741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:06.818801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:06.819575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:06.822113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 111/214] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:06.829044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:06.901318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c66d4-791f-43de-9406-9f2008fcaf83 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:06.919664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:06.943911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:06.944534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.944815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.945088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.946037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:06.947502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:06.947953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b611b2-05c2-468c-8f7a-de63753cfbfb None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:06.956501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:06.975653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 104/215] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:06 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:44:06.996529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:06.997415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:06.997837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:06.998293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:06.999304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:07.000359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:07.002189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:07.012518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 112/216] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:07.019203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:07.132633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29296827-9dd5-4585-bf9d-32f9e3778c97 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:07.169501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7d2b0-0b91-482f-ba79-9c2e09fe5fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:07.170065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d2b0-0b91-482f-ba79-9c2e09fe5fec None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.170373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d2b0-0b91-482f-ba79-9c2e09fe5fec None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.170648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7d2b0-0b91-482f-ba79-9c2e09fe5fec None admin] PATH_INFO: `/v3/users/f598f2b34fe74e3b9f2cc0cb223143ef` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:07.186424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7d2b0-0b91-482f-ba79-9c2e09fe5fec None admin] RBAC: Authorizing `identity:get_user(user_id=f598f2b34fe74e3b9f2cc0cb223143ef)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:07.188093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7d2b0-0b91-482f-ba79-9c2e09fe5fec None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:07.189884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 105/217] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:07 2022] GET /identity/v3/users/f598f2b34fe74e3b9f2cc0cb223143ef => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:07.195963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:07.304770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d6cd-c924-4e87-90bf-e3a8f5cb9561 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:07.340006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:07.340621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.340903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.341174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:07.353840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:07.425488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:07.426995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:07.517520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3508d7c-d7d9-4630-b008-b75f15f6d333 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.518024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3508d7c-d7d9-4630-b008-b75f15f6d333 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.518145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3508d7c-d7d9-4630-b008-b75f15f6d333 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:07.520134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 106/218] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:07.525639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b99ed-4105-4cca-9277-1935f0f11eb5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.525931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b99ed-4105-4cca-9277-1935f0f11eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.526233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b99ed-4105-4cca-9277-1935f0f11eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:07.546075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 113/219] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:07.551085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-586b99ed-4105-4cca-9277-1935f0f11eb5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:07.552376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-586b99ed-4105-4cca-9277-1935f0f11eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:07.552491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:07.602483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:07.609847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:07.660744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 107/220] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:07.698998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13256aaf-072c-4668-b60c-ed8340a6fed2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:07.754821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0244b7-a59f-4348-828a-c72d4165adb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:07.755478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0244b7-a59f-4348-828a-c72d4165adb0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.755754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0244b7-a59f-4348-828a-c72d4165adb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.756028 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0244b7-a59f-4348-828a-c72d4165adb0 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:07.757286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0244b7-a59f-4348-828a-c72d4165adb0 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:07.758770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0244b7-a59f-4348-828a-c72d4165adb0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:07.760577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 114/221] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:07 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:07.766437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b99ed-4105-4cca-9277-1935f0f11eb5 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:07.908783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b99ed-4105-4cca-9277-1935f0f11eb5 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:07.956526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbce75-5be5-4156-bb55-fb1196096ee9 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.956690 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:07.956784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbce75-5be5-4156-bb55-fb1196096ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.957027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbce75-5be5-4156-bb55-fb1196096ee9 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:07.957140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.957310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.957576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:07.958340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=f598f2b34fe74e3b9f2cc0cb223143ef) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:07.958645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:07.958895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 115/222] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:07.961787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:07.967839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 108/223] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:07 2022] GET /identity/v3/role_assignments?user.id=f598f2b34fe74e3b9f2cc0cb223143ef&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:07.973395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe269a6-582e-4323-a0c0-1afec9739e60 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:07.973709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe269a6-582e-4323-a0c0-1afec9739e60 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:07.973949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe269a6-582e-4323-a0c0-1afec9739e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:08.019381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-efe269a6-582e-4323-a0c0-1afec9739e60 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:08.020626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-efe269a6-582e-4323-a0c0-1afec9739e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:08.039542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:08.095192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:08.162150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d0574-f701-4d9a-a204-d948e2863292 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:08.204055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:08.204845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:08.205131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:08.205426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:08.207899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 116/224] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:08.221843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:08.227373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:08.228241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:08.229036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 109/225] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:08.234491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe269a6-582e-4323-a0c0-1afec9739e60 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:08.288002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:08.379631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe269a6-582e-4323-a0c0-1afec9739e60 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:08.430784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:08.431401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:08.431684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:08.431958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:08.432629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:08.432929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:08.434325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:08.442951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 117/226] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:08.448758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:08.534992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:08.572627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec3a66-284f-4d86-94b4-1da80cab45d7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:08.576438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:08.631301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:08.631941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:08.632221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:08.632492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] PATH_INFO: `/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:08.638497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] RBAC: Authorizing `identity:get_user(user_id=ba61ed5f0a97494aad3242d5ee5e77d4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:08.640045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:08.642296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 110/227] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:08 2022] GET /identity/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:08.651430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:08.734916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:08.739814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677aad4-d8dc-41d3-801f-8ef9812aa964 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:08.799057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:08.800038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:08.800508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:08.800967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:08.820342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:08.829674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:08.830597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:08.831633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:08.836572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 118/228] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:08.840512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:08.851044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8829903-ff08-4c7f-8904-dfafb5220330 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:08.911522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:08.912584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:08.916929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:08.917462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:08.918905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:08.920538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:08.924313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 111/229] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:08 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:08.931060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:09.004166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:09.034015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179f6e-5208-4ad1-afa0-2fb5f1ea2281 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:09.100443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:09.101507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.102026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.102515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.103385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:09.104584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:09.106213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:09.110500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c91054-a816-49e8-a505-dffd8c809cfc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:09.124880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 119/230] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:09.129953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:09.175240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:09.176271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.176774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:09.178547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.179024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a/users/ba61ed5f0a97494aad3242d5ee5e77d4/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.182379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c4af6068fd4ce790197475c719687a, user_id=ba61ed5f0a97494aad3242d5ee5e77d4, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:09.185072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:09.208944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 112/231] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:08 2022] PUT /identity/v3/projects/b2c4af6068fd4ce790197475c719687a/users/ba61ed5f0a97494aad3242d5ee5e77d4/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:09.285551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84fab5-5ec0-4362-83cf-6ec7af4fdee0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:09.323741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:09.324768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.325290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.325755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] PATH_INFO: `/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.327363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] RBAC: Authorizing `identity:get_user(user_id=ba61ed5f0a97494aad3242d5ee5e77d4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:09.329889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:09.332584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 120/232] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:09 2022] GET /identity/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:09.339719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:09.465931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:09.474690 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab7bcc-6c91-49f4-9889-7ded782dc39c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:09.525801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b77c9-4432-43d5-88c3-47dd714aa770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:09.526489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b77c9-4432-43d5-88c3-47dd714aa770 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.526767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b77c9-4432-43d5-88c3-47dd714aa770 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.527037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b77c9-4432-43d5-88c3-47dd714aa770 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.528260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b77c9-4432-43d5-88c3-47dd714aa770 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:09.529720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b77c9-4432-43d5-88c3-47dd714aa770 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:09.531760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 113/233] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:09 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:09.537373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:09.662200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:09.674559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c170fef-bf75-4777-b2ac-1369f8a5ad82 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:09.719218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e97939-c930-4b23-8dda-52fd25c06846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:09.719825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97939-c930-4b23-8dda-52fd25c06846 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.720056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f88-72d1-46b4-9b19-99c5a91eee30 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.720467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97939-c930-4b23-8dda-52fd25c06846 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.720550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f88-72d1-46b4-9b19-99c5a91eee30 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.720625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e97939-c930-4b23-8dda-52fd25c06846 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a/users/ba61ed5f0a97494aad3242d5ee5e77d4/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.720692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad910f88-72d1-46b4-9b19-99c5a91eee30 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.722206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 114/234] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:09.722644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e97939-c930-4b23-8dda-52fd25c06846 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c4af6068fd4ce790197475c719687a, user_id=ba61ed5f0a97494aad3242d5ee5e77d4, role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:09.724105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e97939-c930-4b23-8dda-52fd25c06846 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:09.731655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268a3f-bd60-4a2b-bd7a-91549b6e1b3d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.731944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268a3f-bd60-4a2b-bd7a-91549b6e1b3d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.732219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9268a3f-bd60-4a2b-bd7a-91549b6e1b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.749351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 121/235] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:09 2022] PUT /identity/v3/projects/b2c4af6068fd4ce790197475c719687a/users/ba61ed5f0a97494aad3242d5ee5e77d4/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:09.771377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b9268a3f-bd60-4a2b-bd7a-91549b6e1b3d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:09.772692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b9268a3f-bd60-4a2b-bd7a-91549b6e1b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:09.880698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 115/236] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:09.946961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912d94-4c6a-4d5c-bae2-f03f09818859 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.947266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912d94-4c6a-4d5c-bae2-f03f09818859 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.947536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912d94-4c6a-4d5c-bae2-f03f09818859 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.948882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 122/237] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:09.955234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808aba8-e8d0-4ab2-9354-8395082cbbf7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:09.955517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808aba8-e8d0-4ab2-9354-8395082cbbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:09.955794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808aba8-e8d0-4ab2-9354-8395082cbbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:09.975183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0808aba8-e8d0-4ab2-9354-8395082cbbf7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:09.976300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0808aba8-e8d0-4ab2-9354-8395082cbbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:10.049115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 116/238] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:10.196791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc912d94-4c6a-4d5c-bae2-f03f09818859 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:10.327319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc912d94-4c6a-4d5c-bae2-f03f09818859 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:10.372921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:10.373563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:10.373845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:10.374133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:10.391323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:10.396332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:10.397194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:10.397973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 123/239] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:10.406478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808aba8-e8d0-4ab2-9354-8395082cbbf7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:10.409841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:10.423717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:10.472346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:10.578074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbbbc7-36f6-4782-a6e1-045ceaafc372 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:10.604346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808aba8-e8d0-4ab2-9354-8395082cbbf7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:10.630423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:10.631273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:10.631382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:10.631602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:10.638786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:10.640301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:10.642283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 124/240] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:10.647244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:10.650454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:10.651415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:10.651929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:10.652397 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:10.653260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:10.653758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:10.655517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:10.665315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 117/241] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:10.673583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:10.760111 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:10.785027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:10.785928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64beecd-9be2-49ae-a325-329949c40a0e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:10.806043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7287ca-5e2b-45ef-a9cb-9d1785a8f373 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:10.834121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54162a66-3ff0-40f3-bf1f-7b4a61d5f537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:10.834679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54162a66-3ff0-40f3-bf1f-7b4a61d5f537 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:10.834963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54162a66-3ff0-40f3-bf1f-7b4a61d5f537 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:10.835235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54162a66-3ff0-40f3-bf1f-7b4a61d5f537 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:10.835896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54162a66-3ff0-40f3-bf1f-7b4a61d5f537 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:10.837373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54162a66-3ff0-40f3-bf1f-7b4a61d5f537 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:10.855584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:10.856580 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:10.857048 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:10.857535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] PATH_INFO: `/v3/users/93e2aac917d241ecb41253fed5787206` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:10.861931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 125/242] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:10 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:44:10.868731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1835-0d10-4ddf-ac1f-13487b8ecce5 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:10.869015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1835-0d10-4ddf-ac1f-13487b8ecce5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:10.869534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb1835-0d10-4ddf-ac1f-13487b8ecce5 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:10.877163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 126/243] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:10 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:10.880335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] RBAC: Authorizing `identity:get_user(user_id=93e2aac917d241ecb41253fed5787206)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:10.882448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:10.884135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89189e1b-3fa8-40a9-80e1-1086b62f3365 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:10.884667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89189e1b-3fa8-40a9-80e1-1086b62f3365 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:10.885234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89189e1b-3fa8-40a9-80e1-1086b62f3365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:10.891947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 118/244] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:10 2022] GET /identity/v3/users/93e2aac917d241ecb41253fed5787206 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:10.896585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:10.923768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-89189e1b-3fa8-40a9-80e1-1086b62f3365 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:10.925029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-89189e1b-3fa8-40a9-80e1-1086b62f3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:11.064672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 127/245] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:11.096785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31c25-700b-4b73-a451-35ec4f92c7aa None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:11.139000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:11.139616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:11.139895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:11.140721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:11.158494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:11.213073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:11.214646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:11.316593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 119/246] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:11.322246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89189e1b-3fa8-40a9-80e1-1086b62f3365 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:11.371169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:11.420491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:11.444153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:11.504030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65608be2-1f84-4aac-9792-7d5e404911b1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:11.511290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89189e1b-3fa8-40a9-80e1-1086b62f3365 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:11.545621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:11.547097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:11.547276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:11.547532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:11.552458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:11.553373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:11.553839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:11.554355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:11.555805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:11.557518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:11.558444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:11.559654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 128/247] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:11 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:11.564857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:11.565776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:11.566734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 120/248] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:11.568602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:11.572855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:11.715240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e541c-619c-4084-ac3b-dc50f08eac16 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:11.721837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d6789-1b7b-419b-8b92-39aa7c2b72ab None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:11.730137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:11.753150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:11.759350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:11.759891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:11.760496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:11.760602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:11.760787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:11.761037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:11.761435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:11.761706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:11.762005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:11.762376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:11.763284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] RBAC: Adding query filter params (role.id=76d7a4d6a7ae4792a66c9ba23e962577, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=93e2aac917d241ecb41253fed5787206) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:11.763472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:11.763955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:11.766392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:11.773038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 129/249] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:11 2022] GET /identity/v3/role_assignments?user.id=93e2aac917d241ecb41253fed5787206&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=76d7a4d6a7ae4792a66c9ba23e962577 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:11.773548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 121/250] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:11.780210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:11.892938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e597c-9c1c-4103-ba97-3c7868c425d9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:11.929970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:11.930927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:11.931345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:11.931754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] PATH_INFO: `/v3/users/f598f2b34fe74e3b9f2cc0cb223143ef` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:11.933114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] RBAC: Authorizing `identity:get_user(user_id=f598f2b34fe74e3b9f2cc0cb223143ef)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:11.934857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:11.936697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 130/251] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:11 2022] GET /identity/v3/users/f598f2b34fe74e3b9f2cc0cb223143ef => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:11.947310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:12.069541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774893e5-5cee-4aa2-8161-d6b8dfdda8fc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:12.105948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5abdfd-02b1-4c9e-92ee-133a7cfeddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:12.106633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5abdfd-02b1-4c9e-92ee-133a7cfeddba None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:12.106912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5abdfd-02b1-4c9e-92ee-133a7cfeddba None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:12.107186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5abdfd-02b1-4c9e-92ee-133a7cfeddba None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:12.108338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5abdfd-02b1-4c9e-92ee-133a7cfeddba None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:12.110684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5abdfd-02b1-4c9e-92ee-133a7cfeddba None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:12.112650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 122/252] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:11 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:12.118180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:12.199922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:12.246289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043febf-c86b-4314-8eb2-8362e0af2dbc None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:12.288229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2c6cd-7748-4f8c-8553-979a8abd5a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:12.288893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c6cd-7748-4f8c-8553-979a8abd5a1c None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:12.289169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c6cd-7748-4f8c-8553-979a8abd5a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:12.289445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2c6cd-7748-4f8c-8553-979a8abd5a1c None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a/users/f598f2b34fe74e3b9f2cc0cb223143ef/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:12.291363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c6cd-7748-4f8c-8553-979a8abd5a1c None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c4af6068fd4ce790197475c719687a, user_id=f598f2b34fe74e3b9f2cc0cb223143ef, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:12.292833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2c6cd-7748-4f8c-8553-979a8abd5a1c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:12.314296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 131/253] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:12 2022] PUT /identity/v3/projects/b2c4af6068fd4ce790197475c719687a/users/f598f2b34fe74e3b9f2cc0cb223143ef/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:12.435080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a394ca-687b-4af0-a50b-dc16c33b3052 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:12.435358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a394ca-687b-4af0-a50b-dc16c33b3052 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:12.435631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a394ca-687b-4af0-a50b-dc16c33b3052 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:12.437622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 123/254] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:12.443779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d34e-4f23-44bb-aa1e-47f83f6a278d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:12.444098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d34e-4f23-44bb-aa1e-47f83f6a278d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:12.444329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79d34e-4f23-44bb-aa1e-47f83f6a278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:12.471338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fc79d34e-4f23-44bb-aa1e-47f83f6a278d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:12.472568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fc79d34e-4f23-44bb-aa1e-47f83f6a278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:12.558901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 132/255] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:12.709138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881309be-c710-4e96-b032-5a5e134906d8 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:12.709467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881309be-c710-4e96-b032-5a5e134906d8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:12.709711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881309be-c710-4e96-b032-5a5e134906d8 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:12.711292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 124/256] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:12.727175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768d9e-fc05-4d78-a7b3-ea56ec8aea8c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:12.728141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768d9e-fc05-4d78-a7b3-ea56ec8aea8c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:12.728674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61768d9e-fc05-4d78-a7b3-ea56ec8aea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:12.752598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-61768d9e-fc05-4d78-a7b3-ea56ec8aea8c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:12.754120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-61768d9e-fc05-4d78-a7b3-ea56ec8aea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:12.812946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:12.834198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 133/257] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:12.897487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881309be-c710-4e96-b032-5a5e134906d8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:12.939903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:13.008506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881309be-c710-4e96-b032-5a5e134906d8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:13.044771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:13.045408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:13.045684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:13.045955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:13.056942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:13.062187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:13.063188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:13.064415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 125/258] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:13.068994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768d9e-fc05-4d78-a7b3-ea56ec8aea8c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:13.217095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61768d9e-fc05-4d78-a7b3-ea56ec8aea8c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:13.271992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:13.272524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:13.272803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:13.273074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:13.273749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:13.274051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:13.275468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:13.290057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 134/259] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:13.295704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:13.315552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:13.446655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:13.449276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29b105-2abd-4624-89cf-d265bb2ab411 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:13.471323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:13.491536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:13.492614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:13.493094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:13.493619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] PATH_INFO: `/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:13.495290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] RBAC: Authorizing `identity:get_user(user_id=ba61ed5f0a97494aad3242d5ee5e77d4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:13.497029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:13.499423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 126/260] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:13 2022] GET /identity/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:13.505306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:13.589882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ebfd4-e318-4774-92a0-e6935432e0d0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:13.644708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:13.645340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:13.645620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:13.645893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:13.668994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:13.674727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:13.675601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:13.676397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 135/261] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:13.688200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:13.745622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046aed4-4af3-433f-b507-5dbd51f303d8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:13.799840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:13.800468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:13.800738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:13.801002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:13.853718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:13.914065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f05e-0c39-4967-af32-4e83541f5883 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:13.922115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:13.926410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:13.927668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:13.994832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:13.995466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:13.995751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:13.996023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:13.996701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:13.997008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:13.998436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:14.015957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 136/262] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:14.021440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:14.072454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 127/263] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:14.078379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:14.175670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:14.189856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016707-5a6b-407d-9147-6d6695cde9fe None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:14.237332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:14.238508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:14.239810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:14.240890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] PATH_INFO: `/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:14.242455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] RBAC: Authorizing `identity:get_user(user_id=ba61ed5f0a97494aad3242d5ee5e77d4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:14.245112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:14.248838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 137/264] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:14 2022] GET /identity/v3/users/ba61ed5f0a97494aad3242d5ee5e77d4 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:14.251322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2ccfe-851e-44fe-9fa0-5520fdb43b4f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:14.253711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:14.311899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:14.325365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:14.327088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:14.328438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:14.330198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:14.331835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:14.333654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:14.337664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 128/265] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:14 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:14.343920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:14.450825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52adaf-d31b-4f4a-bd28-7a2baa5d83dd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:14.508974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be86f3-5764-4ae8-a5d6-d863772f187c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:14.524169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc8859-188f-4763-887c-3814c1868331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:14.524787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc8859-188f-4763-887c-3814c1868331 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:14.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc8859-188f-4763-887c-3814c1868331 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:14.525330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc8859-188f-4763-887c-3814c1868331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:14.544170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:14.552106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423ea42-30d8-40fe-895a-2db4b4b9f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:14.553131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ea42-30d8-40fe-895a-2db4b4b9f861 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:14.553633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ea42-30d8-40fe-895a-2db4b4b9f861 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:14.554224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423ea42-30d8-40fe-895a-2db4b4b9f861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:14.555230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ea42-30d8-40fe-895a-2db4b4b9f861 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=ba61ed5f0a97494aad3242d5ee5e77d4) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:14.555731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ea42-30d8-40fe-895a-2db4b4b9f861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:14.557443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423ea42-30d8-40fe-895a-2db4b4b9f861 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:14.565390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 129/266] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:14 2022] GET /identity/v3/role_assignments?user.id=ba61ed5f0a97494aad3242d5ee5e77d4&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:14.611654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4392f-20b5-4ad1-b61a-8dbe8406a5d7 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:14.612280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4392f-20b5-4ad1-b61a-8dbe8406a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:14.612749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4392f-20b5-4ad1-b61a-8dbe8406a5d7 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:14.614342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 130/267] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:14.619516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040801d-6b5d-49d5-b151-d49618e69a81 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:14.620129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040801d-6b5d-49d5-b151-d49618e69a81 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:14.620620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040801d-6b5d-49d5-b151-d49618e69a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:14.652803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8040801d-6b5d-49d5-b151-d49618e69a81 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:14.654552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8040801d-6b5d-49d5-b151-d49618e69a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:14.676951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc8859-188f-4763-887c-3814c1868331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:14.680649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc8859-188f-4763-887c-3814c1868331 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:14.758989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:14.808908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 131/268] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:14.885298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 138/269] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:14.891645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040801d-6b5d-49d5-b151-d49618e69a81 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:15.037503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040801d-6b5d-49d5-b151-d49618e69a81 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:15.065700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:15.074692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce5fdf-7493-4ce1-ac1c-6a92c8ee0e66 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.075514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df67f26-3dc9-4ea0-bb59-77429b767301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:15.076021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce5fdf-7493-4ce1-ac1c-6a92c8ee0e66 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.076192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67f26-3dc9-4ea0-bb59-77429b767301 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.076474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67f26-3dc9-4ea0-bb59-77429b767301 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.076749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df67f26-3dc9-4ea0-bb59-77429b767301 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.076993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce5fdf-7493-4ce1-ac1c-6a92c8ee0e66 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.078305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df67f26-3dc9-4ea0-bb59-77429b767301 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:15.079766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df67f26-3dc9-4ea0-bb59-77429b767301 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:15.080570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 139/270] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:15.086114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 132/271] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:14 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:15.087809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce5fdf-7493-4ce1-ac1c-6a92c8ee0e66 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:15.095417 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688015-a335-4d7a-aab8-f174ae293c45 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.095699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688015-a335-4d7a-aab8-f174ae293c45 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.095974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688015-a335-4d7a-aab8-f174ae293c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.115224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-06688015-a335-4d7a-aab8-f174ae293c45 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:15.116539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-06688015-a335-4d7a-aab8-f174ae293c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:15.191657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 133/272] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:15.193032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce93ea-da60-41aa-bd90-64b9a1d7463f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.193314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce93ea-da60-41aa-bd90-64b9a1d7463f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.193584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce93ea-da60-41aa-bd90-64b9a1d7463f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.194912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 134/273] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:15.200256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49d6b-5a57-4174-9531-65f130605e5f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.200542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49d6b-5a57-4174-9531-65f130605e5f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.200817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49d6b-5a57-4174-9531-65f130605e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.221790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3ca49d6b-5a57-4174-9531-65f130605e5f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:15.223209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3ca49d6b-5a57-4174-9531-65f130605e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:15.232786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce5fdf-7493-4ce1-ac1c-6a92c8ee0e66 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:15.273242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:15.273851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.274146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.274419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.275143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] RBAC: Adding query filter params (role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=ba61ed5f0a97494aad3242d5ee5e77d4) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:15.275443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:15.276867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:15.279980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:15.283574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 140/274] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:15 2022] GET /identity/v3/role_assignments?user.id=ba61ed5f0a97494aad3242d5ee5e77d4&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:15.286326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:15.303126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 135/275] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:15.397024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f08f1-8d38-4b99-a454-503adfa5588c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:15.433305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:15.433934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.434237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.434508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.435630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:15.437641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:15.439513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 141/276] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:15.446303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49d6b-5a57-4174-9531-65f130605e5f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:15.510681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:15.561554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49d6b-5a57-4174-9531-65f130605e5f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:15.599627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:15.601159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f8e1f-60f6-4ab7-848c-445741a9c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:15.601786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8e1f-60f6-4ab7-848c-445741a9c9c6 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.602064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8e1f-60f6-4ab7-848c-445741a9c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.602479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f8e1f-60f6-4ab7-848c-445741a9c9c6 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.603147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f8e1f-60f6-4ab7-848c-445741a9c9c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:15.604715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f8e1f-60f6-4ab7-848c-445741a9c9c6 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:15.630028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 136/277] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:15 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:44:15.678651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c1ec-a913-434e-9452-d4070c8b0e43 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.678959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c1ec-a913-434e-9452-d4070c8b0e43 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.679304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569c1ec-a913-434e-9452-d4070c8b0e43 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.681064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 137/278] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:15.687450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beddaf2-18c8-4d7f-bc28-bceaf27813fd None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.687758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beddaf2-18c8-4d7f-bc28-bceaf27813fd None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.688002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beddaf2-18c8-4d7f-bc28-bceaf27813fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.690268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:15.712314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8beddaf2-18c8-4d7f-bc28-bceaf27813fd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:15.714017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8beddaf2-18c8-4d7f-bc28-bceaf27813fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:15.738062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c0915-4def-451e-b98b-57c3d8380c64 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:15.782702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:15.783705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:15.784157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:15.784602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:15.798651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:15.804081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:15.810756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:15.811810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:15.812649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 138/279] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:15.812722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 142/280] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:15.812785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beddaf2-18c8-4d7f-bc28-bceaf27813fd None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:15.817208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:15.862987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:15.949456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beddaf2-18c8-4d7f-bc28-bceaf27813fd None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:15.971272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca3441-97ae-4f0d-a15f-6fec6662a3ae None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:15.998804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.000430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.000933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.001435 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.007430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:16.013854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:16.016623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.017234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.017513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.017782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.018495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:16.018795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:16.019554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:16.020399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:16.021172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:16.021768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.021839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 139/281] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:16.027834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.032253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 143/282] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:16.037993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.153438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:16.156680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab7ee4-b4b0-43b1-a88e-3e46ffb7ff7e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.158640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb4dd5-7d65-4235-838f-635ad2c0aa38 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.199481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.199975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.200117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.200390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.200575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.200672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] PATH_INFO: `/v3/users/93e2aac917d241ecb41253fed5787206` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.200843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.201112 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.201863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:16.202188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] RBAC: Authorizing `identity:get_user(user_id=93e2aac917d241ecb41253fed5787206)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.202304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.203592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.203981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.206751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 144/283] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/users/93e2aac917d241ecb41253fed5787206 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:16.207595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.219232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 140/284] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:16.220685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.281619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:16.334104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e82415-9a90-4c74-8fee-bc2d2f93d62e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.363622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b6cfc-d755-46b2-ada1-282bed8ad119 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.373839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.375096 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.375375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.375646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.386272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:16.392136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:16.394525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:16.396461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 145/285] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:16.402130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.406284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.407867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.408222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.408569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.409798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.411355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.418129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 141/286] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:16.418129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.451131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:16.517914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6a2ec-2a6d-4f0c-b2f4-93e752787eee None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.522759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b7336-5a82-4ffd-8eb4-c2142e801213 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.536494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:16.556647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.557408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.557709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.558050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] PATH_INFO: `/v3/users/a4ed93a9272f4466a1a8fd82104a9bc4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.559232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.560091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.560572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.561033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.562501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:16.563000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.564565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.577522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ed93a9272f4466a1a8fd82104a9bc4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.577522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.577522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 146/287] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/users/a4ed93a9272f4466a1a8fd82104a9bc4 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:16.577522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.578576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 142/288] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:16.579957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.674982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:16.687835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5a41-fe63-41e0-be42-975f1bdb12ab None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.689440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427665da-5a8c-49a1-bceb-be3f35ad1614 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.725206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.726116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.726533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.726942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] PATH_INFO: `/v3/users/f598f2b34fe74e3b9f2cc0cb223143ef` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.728190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] RBAC: Authorizing `identity:get_user(user_id=f598f2b34fe74e3b9f2cc0cb223143ef)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.729906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.731767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 143/289] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/users/f598f2b34fe74e3b9f2cc0cb223143ef => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:16.732736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.737506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.738405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.739128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.739592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a/users/93e2aac917d241ecb41253fed5787206/roles/76d7a4d6a7ae4792a66c9ba23e962577` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.742771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c4af6068fd4ce790197475c719687a, user_id=93e2aac917d241ecb41253fed5787206, role_id=76d7a4d6a7ae4792a66c9ba23e962577)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.744387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.766341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 147/290] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:16 2022] PUT /identity/v3/projects/b2c4af6068fd4ce790197475c719687a/users/93e2aac917d241ecb41253fed5787206/roles/76d7a4d6a7ae4792a66c9ba23e962577 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:16.767328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:16.809265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:16.886434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3fcb-dff5-4910-8cb4-5a30cab8f0f2 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.887941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e9faa-74b5-4e90-a4ba-04433abb0fce None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:16.936779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.937404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.937758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.938126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.939066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, user.id=a4ed93a9272f4466a1a8fd82104a9bc4, scope.system=all) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:16.939449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:16.939857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:16.940682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:16.941137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:16.941240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:16.941674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:16.947781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 144/291] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/role_assignments?user.id=a4ed93a9272f4466a1a8fd82104a9bc4&scope.system=all&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:17.028565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:17.030995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:17.071904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:17.148263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 148/292] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:17.154210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:17.187541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:17.263168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c79387-620d-4fbe-a328-e2a77a8971f1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:17.298361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b16fb-a818-4882-a4da-9ad1aacd98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:17.298992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b16fb-a818-4882-a4da-9ad1aacd98fc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:17.299263 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b16fb-a818-4882-a4da-9ad1aacd98fc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:17.299527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b16fb-a818-4882-a4da-9ad1aacd98fc None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:17.300628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b16fb-a818-4882-a4da-9ad1aacd98fc None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:17.302052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b16fb-a818-4882-a4da-9ad1aacd98fc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:17.308541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 145/293] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:17 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:17.309879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:17.434423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fc358-7691-446e-a722-b737361f37a4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:17.469888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7ce71-b415-4653-adc0-96cb88cf535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:17.470437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ce71-b415-4653-adc0-96cb88cf535b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:17.470711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ce71-b415-4653-adc0-96cb88cf535b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:17.470977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ce71-b415-4653-adc0-96cb88cf535b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:17.471701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ce71-b415-4653-adc0-96cb88cf535b None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=f598f2b34fe74e3b9f2cc0cb223143ef) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:17.472001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ce71-b415-4653-adc0-96cb88cf535b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:17.473426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ce71-b415-4653-adc0-96cb88cf535b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:17.476447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:17.486232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 149/294] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:17 2022] GET /identity/v3/role_assignments?user.id=f598f2b34fe74e3b9f2cc0cb223143ef&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:18.234889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7f8f-1c21-4ce2-b7bd-d5b3fa1f693d None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:18.235395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7f8f-1c21-4ce2-b7bd-d5b3fa1f693d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:18.235470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad7f8f-1c21-4ce2-b7bd-d5b3fa1f693d None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:18.237018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 146/295] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:18.242302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c0026-1610-45e6-8ffb-acbae4f29b2d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:18.242593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c0026-1610-45e6-8ffb-acbae4f29b2d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:18.242871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c0026-1610-45e6-8ffb-acbae4f29b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:18.261812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-881c0026-1610-45e6-8ffb-acbae4f29b2d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:18.263047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-881c0026-1610-45e6-8ffb-acbae4f29b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:18.333804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 150/296] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:18.449251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77ff8-20bc-4ed1-a9c3-e19b5e4c9f1c None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:18.449631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77ff8-20bc-4ed1-a9c3-e19b5e4c9f1c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:18.449801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77ff8-20bc-4ed1-a9c3-e19b5e4c9f1c None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:18.451332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 147/297] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:18.457370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d791-c9be-478c-a033-bbc436f4ccee None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:18.457653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d791-c9be-478c-a033-bbc436f4ccee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:18.457990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877d791-c9be-478c-a033-bbc436f4ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:18.477428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4877d791-c9be-478c-a033-bbc436f4ccee None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:18.478659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4877d791-c9be-478c-a033-bbc436f4ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:18.549093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 151/298] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:18.620099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f77ff8-20bc-4ed1-a9c3-e19b5e4c9f1c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:18.726173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:18.736379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f77ff8-20bc-4ed1-a9c3-e19b5e4c9f1c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:18.770415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:18.771382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:18.771874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:18.772331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:18.782677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:18.787673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:18.788536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:18.789321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:18.791904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 148/299] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:18.798066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877d791-c9be-478c-a033-bbc436f4ccee None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:18.823712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:18.872992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:18.922007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877d791-c9be-478c-a033-bbc436f4ccee None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:18.928369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55f27-3120-4b8a-b2b1-ea4bdd68408c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:18.967047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:18.967967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:18.968322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:18.968750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:18.969586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:18.969964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:18.971725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:18.971969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:18.972780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:18.973604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:18.974071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:18.975866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:18.978139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:18.984996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 152/300] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:18.985154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 149/301] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:18.987604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:18.991706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:19.016765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:19.103630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd424448-dc6b-461c-9b2c-fc6d98d7b181 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:19.104648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c70c-c7e1-48e6-acea-be2ffb2d54c4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:19.132924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:19.141152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942e69f-26e9-481e-8b63-f53eabc71f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:19.142068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e69f-26e9-481e-8b63-f53eabc71f3a None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.142507 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:19.142998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e69f-26e9-481e-8b63-f53eabc71f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.143125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.143399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.143668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] PATH_INFO: `/v3/users/f4240c1afbde4188a87792c922433c78` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.143987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942e69f-26e9-481e-8b63-f53eabc71f3a None admin] PATH_INFO: `/v3/groups` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.144820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e69f-26e9-481e-8b63-f53eabc71f3a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:19.146817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942e69f-26e9-481e-8b63-f53eabc71f3a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:19.158651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] RBAC: Authorizing `identity:get_user(user_id=f4240c1afbde4188a87792c922433c78)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:19.160287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:19.162602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 150/302] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:18 2022] GET /identity/v3/users/f4240c1afbde4188a87792c922433c78 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:19.168156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:19.170404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 153/303] 10.222.0.52 () {60 vars in 1134 bytes} [Fri Sep 9 14:44:18 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:44:19.256091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:19.280077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e29c23-9af6-4555-a4a7-4ee685e1564a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:19.320869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b20a29-e191-4178-b521-75d1fb0303b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:19.321497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20a29-e191-4178-b521-75d1fb0303b3 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.321770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20a29-e191-4178-b521-75d1fb0303b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.322035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b20a29-e191-4178-b521-75d1fb0303b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.322814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b20a29-e191-4178-b521-75d1fb0303b3 None admin] RBAC: Adding query filter params (role.id=76d7a4d6a7ae4792a66c9ba23e962577, user.id=f4240c1afbde4188a87792c922433c78, scope.system=all) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:19.323117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b20a29-e191-4178-b521-75d1fb0303b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:19.324610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b20a29-e191-4178-b521-75d1fb0303b3 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:19.330769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 151/304] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Sep 9 14:44:19 2022] GET /identity/v3/role_assignments?user.id=f4240c1afbde4188a87792c922433c78&scope.system=all&role.id=76d7a4d6a7ae4792a66c9ba23e962577 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:19.433786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da0865-12d9-40b6-a9db-036583d05d32 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.434324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da0865-12d9-40b6-a9db-036583d05d32 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.434399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da0865-12d9-40b6-a9db-036583d05d32 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.436031 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 154/305] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:19.442284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a85965-3f3b-44e1-84af-370575267357 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.442589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a85965-3f3b-44e1-84af-370575267357 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.442830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a85965-3f3b-44e1-84af-370575267357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.462732 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-05a85965-3f3b-44e1-84af-370575267357 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:19.463961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-05a85965-3f3b-44e1-84af-370575267357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:19.481680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950a1f-6d8d-49b1-b62c-6ee3a0b429c2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.482372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950a1f-6d8d-49b1-b62c-6ee3a0b429c2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.482863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950a1f-6d8d-49b1-b62c-6ee3a0b429c2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.485622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 155/306] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:19.491890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bdecc-938b-4446-9c80-e6f2a955a53a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.492592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bdecc-938b-4446-9c80-e6f2a955a53a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.493094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bdecc-938b-4446-9c80-e6f2a955a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.513995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-261bdecc-938b-4446-9c80-e6f2a955a53a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:19.516356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-261bdecc-938b-4446-9c80-e6f2a955a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:19.539336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 152/307] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:19.595584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 156/308] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:19.807844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a85965-3f3b-44e1-84af-370575267357 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:19.878055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bdecc-938b-4446-9c80-e6f2a955a53a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:19.886793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:19.913005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a85965-3f3b-44e1-84af-370575267357 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:19.960460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:19.961007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:19.961282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:19.961548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:19.973714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:19.979136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:19.979983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:19.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 153/309] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:19.986796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:19.993419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bdecc-938b-4446-9c80-e6f2a955a53a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:20.034923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.035564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.035843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.036122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.047355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:20.052229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:20.054409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:20.056406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:20.062490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 157/310] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:20.063327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:20.096183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426f65a-0868-4421-b8da-1489e74ea52d None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.130893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:20.137398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.138005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.138321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.138594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.139322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:20.139628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:20.141923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:20.155497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 154/311] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:20.156440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:20.196096 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02add13-fac1-49ec-9140-e84f7e85e77f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.245442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.246272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.246560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.246837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.247765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:20.248450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:20.250428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:20.262112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 158/312] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:20.268246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:20.272988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec4829-9c22-4cbf-96e5-11625cf3363f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.311096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.312232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.312709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.313173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] PATH_INFO: `/v3/users/a4ed93a9272f4466a1a8fd82104a9bc4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.314599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ed93a9272f4466a1a8fd82104a9bc4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:20.315976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:20.316804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:20.319272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 155/313] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:20 2022] GET /identity/v3/users/a4ed93a9272f4466a1a8fd82104a9bc4 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:20.324862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:20.396819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f2f6e-9144-4650-a241-a926acc61fbb None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.405530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:20.434681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.435967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.436443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.437524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] PATH_INFO: `/v3/users/93e2aac917d241ecb41253fed5787206` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.439182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] RBAC: Authorizing `identity:get_user(user_id=93e2aac917d241ecb41253fed5787206)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:20.441004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:20.443207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 159/314] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:20 2022] GET /identity/v3/users/93e2aac917d241ecb41253fed5787206 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:20.448941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:20.462586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe8c19-fc02-4f34-94d0-dec5d99b1680 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.506354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.507352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.508399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.508882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] PATH_INFO: `/v3/system/users/a4ed93a9272f4466a1a8fd82104a9bc4/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.510887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a4ed93a9272f4466a1a8fd82104a9bc4, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:20.512653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:20.525191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 156/315] 10.222.0.52 () {58 vars in 1334 bytes} [Fri Sep 9 14:44:20 2022] PUT /identity/v3/system/users/a4ed93a9272f4466a1a8fd82104a9bc4/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:44:20.571440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba967d-5d68-442a-8a25-85bba6ea71e5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.573222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:20.614410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.615424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.616043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.616557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.699544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:20.706113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:20.809506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 160/316] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 14:44:20.815804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:20.926465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97abe-22fe-4798-a346-fed2fed97288 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:20.953569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:20.962886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbe762-7be3-4289-a0f5-302354d5ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:20.963531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe762-7be3-4289-a0f5-302354d5ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:20.963811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe762-7be3-4289-a0f5-302354d5ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:20.964086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbe762-7be3-4289-a0f5-302354d5ebd5 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:20.965233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbe762-7be3-4289-a0f5-302354d5ebd5 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:20.966727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbe762-7be3-4289-a0f5-302354d5ebd5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:20.973567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 157/317] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:20 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:20.974615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:20.976981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:21.086599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622b14d-55bb-4506-aa4d-97f9b5662b1e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:21.122296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e91aa-cc8a-4ba7-8fc9-268faaa57ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:21.122908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e91aa-cc8a-4ba7-8fc9-268faaa57ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:21.123193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e91aa-cc8a-4ba7-8fc9-268faaa57ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:21.123467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e91aa-cc8a-4ba7-8fc9-268faaa57ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:21.124811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e91aa-cc8a-4ba7-8fc9-268faaa57ec7 None admin] RBAC: Adding query filter params (role.id=76d7a4d6a7ae4792a66c9ba23e962577, scope.project.id=b2c4af6068fd4ce790197475c719687a, user.id=93e2aac917d241ecb41253fed5787206) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:21.125126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e91aa-cc8a-4ba7-8fc9-268faaa57ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:21.126596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e91aa-cc8a-4ba7-8fc9-268faaa57ec7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:21.132656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 161/318] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:20 2022] GET /identity/v3/role_assignments?user.id=93e2aac917d241ecb41253fed5787206&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=76d7a4d6a7ae4792a66c9ba23e962577 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:21.423976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b56615-2896-49d7-9fd4-03daf7f114b1 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:21.424486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b56615-2896-49d7-9fd4-03daf7f114b1 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:21.424561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b56615-2896-49d7-9fd4-03daf7f114b1 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:21.425860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 158/319] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:21.431192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f060b-ef18-4999-b059-8dd0413084fd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:21.431554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f060b-ef18-4999-b059-8dd0413084fd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:21.431899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f060b-ef18-4999-b059-8dd0413084fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:21.450133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-352f060b-ef18-4999-b059-8dd0413084fd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:21.451321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-352f060b-ef18-4999-b059-8dd0413084fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:21.519056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:21.530141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 162/320] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:21.590843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a606ba-4b56-4c65-bd92-d6ff34a4d639 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:21.591139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a606ba-4b56-4c65-bd92-d6ff34a4d639 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:21.591399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a606ba-4b56-4c65-bd92-d6ff34a4d639 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:21.593349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 159/321] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:21.598368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c090-c092-44c9-bbf0-79c21fc0cd25 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:21.598657 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c090-c092-44c9-bbf0-79c21fc0cd25 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:21.598931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c090-c092-44c9-bbf0-79c21fc0cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:21.617281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-87f3c090-c092-44c9-bbf0-79c21fc0cd25 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:21.618480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-87f3c090-c092-44c9-bbf0-79c21fc0cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:21.694302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 163/322] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:21.799961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a606ba-4b56-4c65-bd92-d6ff34a4d639 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:21.907331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a606ba-4b56-4c65-bd92-d6ff34a4d639 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:21.941343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:21.941964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:21.943535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:21.943535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:21.944447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:21.945869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:21.947670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 160/323] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:21.953545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3c090-c092-44c9-bbf0-79c21fc0cd25 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:21.964259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:22.034972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:22.059792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3c090-c092-44c9-bbf0-79c21fc0cd25 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:22.075410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab456fcf-0dcf-4ba9-8852-eca250fdbd6f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:22.089194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:22.099700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:22.100305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:22.100584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:22.100857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] PATH_INFO: `/v3/groups` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:22.101495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:22.102966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:22.112884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:22.113585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:22.113902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:22.114209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:22.120305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 164/324] 10.222.0.52 () {60 vars in 1134 bytes} [Fri Sep 9 14:44:21 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:44:22.134783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:22.141097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:22.142114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:22.142951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:22.144246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 161/325] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:22.148338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:22.259791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52d508-fb9c-44d3-bf24-e3f4ee4adb29 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:22.297056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:22.297891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:22.298206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:22.298483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:22.299151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:22.299454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:22.300832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:22.309308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 165/326] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:22.315339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:22.423722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6de5-3035-42b8-bfc1-619696b715c9 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:22.446851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:22.461961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f89f2c-2358-406a-bb3d-ef322c31300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:22.462618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f89f2c-2358-406a-bb3d-ef322c31300e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:22.462895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f89f2c-2358-406a-bb3d-ef322c31300e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:22.463164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f89f2c-2358-406a-bb3d-ef322c31300e None admin] PATH_INFO: `/v3/users/f4240c1afbde4188a87792c922433c78` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:22.464282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f89f2c-2358-406a-bb3d-ef322c31300e None admin] RBAC: Authorizing `identity:get_user(user_id=f4240c1afbde4188a87792c922433c78)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:22.465718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f89f2c-2358-406a-bb3d-ef322c31300e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:22.467631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 162/327] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:22 2022] GET /identity/v3/users/f4240c1afbde4188a87792c922433c78 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:22.473864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:22.528319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:22.587220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ad770d-79b5-4b5d-9b64-242fbaf89122 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:22.623814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2236b6-2c9c-4b9b-8000-e700efb68fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:22.624599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2236b6-2c9c-4b9b-8000-e700efb68fd2 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:22.624968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2236b6-2c9c-4b9b-8000-e700efb68fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:22.625239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2236b6-2c9c-4b9b-8000-e700efb68fd2 None admin] PATH_INFO: `/v3/system/users/f4240c1afbde4188a87792c922433c78/roles/76d7a4d6a7ae4792a66c9ba23e962577` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:22.626697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2236b6-2c9c-4b9b-8000-e700efb68fd2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f4240c1afbde4188a87792c922433c78, role_id=76d7a4d6a7ae4792a66c9ba23e962577)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:22.628180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2236b6-2c9c-4b9b-8000-e700efb68fd2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:22.640826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 166/328] 10.222.0.52 () {58 vars in 1334 bytes} [Fri Sep 9 14:44:22 2022] PUT /identity/v3/system/users/f4240c1afbde4188a87792c922433c78/roles/76d7a4d6a7ae4792a66c9ba23e962577 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:44:22.864776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3c87-b016-4b92-9e59-02ac1cd8c3d2 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:22.865115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3c87-b016-4b92-9e59-02ac1cd8c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:22.865245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde3c87-b016-4b92-9e59-02ac1cd8c3d2 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:22.866823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 163/329] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:22.872354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e90ce-ab54-4848-8ef3-25dc1f24b2f0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:22.872643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e90ce-ab54-4848-8ef3-25dc1f24b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:22.872919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e90ce-ab54-4848-8ef3-25dc1f24b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:22.896209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0b4e90ce-ab54-4848-8ef3-25dc1f24b2f0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:22.897423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0b4e90ce-ab54-4848-8ef3-25dc1f24b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:22.993559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 167/330] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:23.403199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3c87-b016-4b92-9e59-02ac1cd8c3d2 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:23.540002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde3c87-b016-4b92-9e59-02ac1cd8c3d2 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:23.588305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:23.589297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:23.589785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:23.590272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:23.605132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:23.610347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:23.611206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:23.611993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:23.614488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 164/331] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:23.623180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e90ce-ab54-4848-8ef3-25dc1f24b2f0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:23.692084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:23.772275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e90ce-ab54-4848-8ef3-25dc1f24b2f0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:23.811022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:23.812162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:23.812473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:23.812800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:23.813492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:23.813794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:23.815209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:23.824094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 168/332] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:23.830661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:23.901147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:23.968763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97268e6a-e688-4b29-b048-e04814becc13 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:24.008328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68b160-bceb-41ce-8ad3-fea91673f082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:24.008960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b160-bceb-41ce-8ad3-fea91673f082 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:24.009233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b160-bceb-41ce-8ad3-fea91673f082 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:24.009500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b160-bceb-41ce-8ad3-fea91673f082 None admin] PATH_INFO: `/v3/users/a4ed93a9272f4466a1a8fd82104a9bc4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:24.010633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68b160-bceb-41ce-8ad3-fea91673f082 None admin] RBAC: Authorizing `identity:get_user(user_id=a4ed93a9272f4466a1a8fd82104a9bc4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:24.012133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68b160-bceb-41ce-8ad3-fea91673f082 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:24.014009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 165/333] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:23 2022] GET /identity/v3/users/a4ed93a9272f4466a1a8fd82104a9bc4 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:24.020397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:24.158353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8befb0-3563-4feb-8e87-17be82e6f12c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:24.164054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:24.206074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e05b5-cd50-4c3d-8936-4588c9097722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:24.206957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e05b5-cd50-4c3d-8936-4588c9097722 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:24.207299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e05b5-cd50-4c3d-8936-4588c9097722 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:24.207571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e05b5-cd50-4c3d-8936-4588c9097722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:24.208349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e05b5-cd50-4c3d-8936-4588c9097722 None admin] RBAC: Adding query filter params (role.id=b60e4f6e616d4b0bb7f4522d885667be, user.id=a4ed93a9272f4466a1a8fd82104a9bc4, scope.system=all) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:24.208661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e05b5-cd50-4c3d-8936-4588c9097722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:24.210103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e05b5-cd50-4c3d-8936-4588c9097722 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:24.227006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 169/334] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Sep 9 14:44:24 2022] GET /identity/v3/role_assignments?user.id=a4ed93a9272f4466a1a8fd82104a9bc4&scope.system=all&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:25.086055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200071ab-4af1-4ee4-aa45-3a699534ed71 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:25.086582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200071ab-4af1-4ee4-aa45-3a699534ed71 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:25.086582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200071ab-4af1-4ee4-aa45-3a699534ed71 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:25.088365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 166/335] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:25.094814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f50d22-69f8-4555-9e41-307e6d2268c9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:25.095322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f50d22-69f8-4555-9e41-307e6d2268c9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:25.095508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f50d22-69f8-4555-9e41-307e6d2268c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:25.116433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d8f50d22-69f8-4555-9e41-307e6d2268c9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:25.117614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d8f50d22-69f8-4555-9e41-307e6d2268c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:25.204448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 170/336] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:25.571083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963b42-53e8-422c-a631-6f471b40bdaa None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:25.571491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963b42-53e8-422c-a631-6f471b40bdaa None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:25.571663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0963b42-53e8-422c-a631-6f471b40bdaa None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:25.573330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 167/337] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:25.578577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539086-7faf-4f53-bf2b-f5afcbbc431e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:25.578858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539086-7faf-4f53-bf2b-f5afcbbc431e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:25.579126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539086-7faf-4f53-bf2b-f5afcbbc431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:25.601021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-11539086-7faf-4f53-bf2b-f5afcbbc431e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:25.602212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-11539086-7faf-4f53-bf2b-f5afcbbc431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:25.688474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 171/338] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:25.784158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0963b42-53e8-422c-a631-6f471b40bdaa None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:25.914758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0963b42-53e8-422c-a631-6f471b40bdaa None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:25.937831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:25.945216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdabd8b-8bcb-46fb-9925-7e7ad7271f5b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:25.945791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdabd8b-8bcb-46fb-9925-7e7ad7271f5b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:25.946355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdabd8b-8bcb-46fb-9925-7e7ad7271f5b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:25.948167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 172/339] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:25.953338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47d8e-9b81-40c9-9fdc-144de454e051 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:25.953626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47d8e-9b81-40c9-9fdc-144de454e051 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:25.953902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47d8e-9b81-40c9-9fdc-144de454e051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:25.961062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:25.961697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:25.961972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:25.962267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:25.977292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:25.983165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:25.984657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:25.985527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:25.988101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 168/340] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:25.993123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1dc47d8e-9b81-40c9-9fdc-144de454e051 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:25.993123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1dc47d8e-9b81-40c9-9fdc-144de454e051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:25.999077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:26.029186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:26.146225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 173/341] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:26.147894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc47d8e-9b81-40c9-9fdc-144de454e051 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:26.206201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d33fb-62d8-4b7a-a52f-b3a70dc7524c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:26.254043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:26.254685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:26.254963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:26.255232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:26.255901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:26.256206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:26.257698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:26.272111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 169/342] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:26.277797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:26.294159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc47d8e-9b81-40c9-9fdc-144de454e051 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:26.339067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:26.348698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:26.349664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:26.350099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:26.350512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:26.370827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:26.376708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:26.377826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:26.378774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:26.380631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 174/343] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:26.386643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:26.417305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:26.461761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedca285-5735-4ab8-9fe3-0f6bbe36f96f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:26.526754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:26.527367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:26.527642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:26.527910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:26.604731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842aa1d-83d7-4cda-8c97-6c6a3481dec6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:26.666649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:26.667728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465d092-8029-4fa0-9be2-ca4ed95c5f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:26.668134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:26.668348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d092-8029-4fa0-9be2-ca4ed95c5f16 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:26.668629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d092-8029-4fa0-9be2-ca4ed95c5f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:26.668903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d092-8029-4fa0-9be2-ca4ed95c5f16 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:26.669574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465d092-8029-4fa0-9be2-ca4ed95c5f16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:26.669929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465d092-8029-4fa0-9be2-ca4ed95c5f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:26.672187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465d092-8029-4fa0-9be2-ca4ed95c5f16 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:26.688211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 175/344] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:26.689596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76530-2118-4612-b4c8-19350b62ecd4 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:26.689875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76530-2118-4612-b4c8-19350b62ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:26.694663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d76530-2118-4612-b4c8-19350b62ecd4 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:26.701630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 176/345] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:26.702379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76530-2118-4612-b4c8-19350b62ecd4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:26.725111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:26.805313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 170/346] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 14:44:26.810112 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:26.830867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:26.872488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d76530-2118-4612-b4c8-19350b62ecd4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:26.921185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4b4e9-48cc-4f07-af7c-d7267c05ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:26.922805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b4e9-48cc-4f07-af7c-d7267c05ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:26.923528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b4e9-48cc-4f07-af7c-d7267c05ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:26.923997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4b4e9-48cc-4f07-af7c-d7267c05ddf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:26.936474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4b4e9-48cc-4f07-af7c-d7267c05ddf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c7b4b4e9-48cc-4f07-af7c-d7267c05ddf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:26.944886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:26.945920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:26.946768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 177/347] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:26.949791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9eb70-eed2-4411-9ed1-f9c244ce176f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:26.949791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9eb70-eed2-4411-9ed1-f9c244ce176f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:26.949791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9eb70-eed2-4411-9ed1-f9c244ce176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:26.956408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298e4c2-b381-436f-aaa7-42c8aa01a43b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:26.975964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-18b9eb70-eed2-4411-9ed1-f9c244ce176f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:26.977087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-18b9eb70-eed2-4411-9ed1-f9c244ce176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:27.008910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:27.009891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.010419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.010991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.024328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:27.080682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 178/348] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:27.082827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e657c-a30f-47a6-a5a6-56a8628fdf40 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.083352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e657c-a30f-47a6-a5a6-56a8628fdf40 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.083823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e657c-a30f-47a6-a5a6-56a8628fdf40 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.085344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 179/349] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:27.086334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e657c-a30f-47a6-a5a6-56a8628fdf40 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.104646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:27.105939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:27.191062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:27.246448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 171/350] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:27.247628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e657c-a30f-47a6-a5a6-56a8628fdf40 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:27.248236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.295490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbda42-ca75-4982-8c58-b71c1fd45e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:27.296329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbda42-ca75-4982-8c58-b71c1fd45e19 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.296708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbda42-ca75-4982-8c58-b71c1fd45e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.296988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbda42-ca75-4982-8c58-b71c1fd45e19 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.298315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbda42-ca75-4982-8c58-b71c1fd45e19 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:27.299777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbda42-ca75-4982-8c58-b71c1fd45e19 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:27.302123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 180/351] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:27.302948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0042-d884-49ee-ab4e-00ceb7403ba9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.303235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0042-d884-49ee-ab4e-00ceb7403ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.303568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0042-d884-49ee-ab4e-00ceb7403ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.311302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:27.324680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-237c0042-d884-49ee-ab4e-00ceb7403ba9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:27.325878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-237c0042-d884-49ee-ab4e-00ceb7403ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:27.406412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cdd1e-42c0-4c7e-8b66-b6142ce055df None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:27.427956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 181/352] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:27.429149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0042-d884-49ee-ab4e-00ceb7403ba9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.458725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:27.459423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.459708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.461978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.461978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:27.461978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:27.462328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:27.475101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 172/353] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:27.475989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.510865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:27.556724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0042-d884-49ee-ab4e-00ceb7403ba9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:27.597467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:27.598579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.599060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.599576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.601153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:27.603153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:27.610656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 182/354] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:27.612007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.612596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f7571-2b1e-4fc2-9a8f-7df5562a1cb0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:27.615773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:27.676596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:27.677010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.677292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.677566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.692594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:27.694474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:27.702654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 173/355] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:27.704008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.752602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6ae25-96c5-49ba-8ec6-25652810109b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:27.787143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:27.794543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:27.795181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.795458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.795726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.808420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:27.813493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:27.814457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 183/356] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:27.816209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.837867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff47454-875d-4761-a807-1ce7853ef651 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:27.875157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:27.876167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:27.876614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:27.877211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] PATH_INFO: `/v3/users/f4240c1afbde4188a87792c922433c78` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:27.878745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] RBAC: Authorizing `identity:get_user(user_id=f4240c1afbde4188a87792c922433c78)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:27.880488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:27.882794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 174/357] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/users/f4240c1afbde4188a87792c922433c78 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:27.883635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:27.941252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:27.950852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b399543-a552-4540-a42c-9cc7dcf8919f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.001169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.001970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.002283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.003392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.003686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.005141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.006989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 184/358] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:28.007484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.031260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d93f76-5664-4cf1-a597-8a75b4c3eaa2 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.075687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:28.077421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af382a58-c520-40b6-94ef-57e6ad15018e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.077954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af382a58-c520-40b6-94ef-57e6ad15018e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.078282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af382a58-c520-40b6-94ef-57e6ad15018e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.078661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af382a58-c520-40b6-94ef-57e6ad15018e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.079277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af382a58-c520-40b6-94ef-57e6ad15018e None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=3077daafa0204db79297f77f460c5c23) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:28.079588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af382a58-c520-40b6-94ef-57e6ad15018e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.081221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af382a58-c520-40b6-94ef-57e6ad15018e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.088469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 175/359] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:27 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:28.090229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac341d7-1384-43ea-b2ea-5f89c234108a None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.090229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac341d7-1384-43ea-b2ea-5f89c234108a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.090229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac341d7-1384-43ea-b2ea-5f89c234108a None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.090845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 176/360] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:28.091551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac341d7-1384-43ea-b2ea-5f89c234108a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.135898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ccdfb-7338-43c7-8aef-a2000fc37e05 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.186391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.187264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.188231 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.188520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.208293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:28.215129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:28.216073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:28.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:28.220242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 185/361] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:28.221332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.230313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:28.236340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac341d7-1384-43ea-b2ea-5f89c234108a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.282984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.284171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.284455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.284727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.285406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:28.285714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.287881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.300424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 177/362] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:28.301665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.361768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d787-47d4-4080-aaea-e243595f45b0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.382703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:28.406940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d426b4-e99a-4da5-b00f-171b9bb571a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.407832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d426b4-e99a-4da5-b00f-171b9bb571a8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.408260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d426b4-e99a-4da5-b00f-171b9bb571a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.408677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d426b4-e99a-4da5-b00f-171b9bb571a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.409548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d426b4-e99a-4da5-b00f-171b9bb571a8 None admin] RBAC: Adding query filter params (role.id=76d7a4d6a7ae4792a66c9ba23e962577, user.id=f4240c1afbde4188a87792c922433c78, scope.system=all) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:28.410001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d426b4-e99a-4da5-b00f-171b9bb571a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.411661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d426b4-e99a-4da5-b00f-171b9bb571a8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.424935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 186/363] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/role_assignments?user.id=f4240c1afbde4188a87792c922433c78&scope.system=all&role.id=76d7a4d6a7ae4792a66c9ba23e962577 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:28.426523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326be9e-8062-464f-95f2-30ec19b6996f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.426956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326be9e-8062-464f-95f2-30ec19b6996f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.428340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326be9e-8062-464f-95f2-30ec19b6996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.435322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bac9e9-263d-4c12-a7b1-43cb4a6817e7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.453807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e326be9e-8062-464f-95f2-30ec19b6996f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:28.455559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e326be9e-8062-464f-95f2-30ec19b6996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:28.487194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.488403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.488888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.489303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.490232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=3077daafa0204db79297f77f460c5c23) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:28.490692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.492342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.500040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 178/364] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:28.501147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.540078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:28.555221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 187/365] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:28.556209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326be9e-8062-464f-95f2-30ec19b6996f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.646520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102ad3e-600d-43b4-90a5-20309d2d126e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.686833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326be9e-8062-464f-95f2-30ec19b6996f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.698992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:28.708695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.709426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.709704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.709974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.710702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:28.711003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.712608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.723964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 179/366] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:28.729562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.735008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.735970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.736426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.736882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.819682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.821637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.829776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:28.846984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b7508-3450-4cf8-91d1-6ac9178ba560 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:28.883958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:28.884572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:28.884853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:28.885125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:28.959860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:28.961361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:28.981467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 188/367] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:28.987145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:28.996009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.056619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.073080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 180/368] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 14:44:29.073080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.121199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65c28-d31f-401f-9b4c-2c933a69b9dd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.166341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.167522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.167965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.168399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.169772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:29.171844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:29.174232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 189/369] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:28 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:29.175241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.190072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fe7a8-b43e-4743-a44b-1b09f1eabfe2 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.230014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.230571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.230922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.231293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.243411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:29.248982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:29.249927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:29.251039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 181/370] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:29.252602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.277268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.304033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bac740-0b2b-4253-82a2-d8109087340a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.315362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.342230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.343526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.344042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.344595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.345942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:29.347617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:29.349469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 190/371] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:29.350458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.383409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc24f0f-9087-4799-896d-843ce40cbd6b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.428766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.428766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.428766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.429117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.430047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:29.431654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:29.434130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 182/372] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:29.434909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.472735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f26d5b-8ec3-4bc3-9853-056b3829a5e5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.516500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.517032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.517315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.517589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.518988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:29.519303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:29.520677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:29.536289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 191/373] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:29.537209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.547691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.565501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b53b6-aced-43b0-bd6b-f59190fd13df None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.600765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.616721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.617642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.617993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.618419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.620524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:29.622189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:29.623834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 183/374] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:29.624957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.656746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b03cae-7bf0-48f5-b0bc-1ced245c23fd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.710820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.711675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.712148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.712608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.713531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=b2c4af6068fd4ce790197475c719687a) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:29.714053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:29.715777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:29.726256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 192/375] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:29.727397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:29.749216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd005b-ab80-4b60-b5cd-20246e80b968 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:29.789867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:29.790449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:29.790722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:29.790984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:29.855520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.873306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:29.875393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:29.930117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:29.995132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 184/376] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:30.001883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:30.016768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566fba5-8742-4d02-9e18-466309ec6b95 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:30.065544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:30.066574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:30.067060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:30.067564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:30.068501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=b2c4af6068fd4ce790197475c719687a) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:30.069030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:30.074890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:30.087389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 193/377] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:29 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 260 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:30.115724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:30.136534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e1594-9f10-4c01-bd58-acacfaebd7a8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:30.178167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:30.178807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:30.179079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:30.179346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] PATH_INFO: `/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:30.180576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] RBAC: Authorizing `identity:get_project(project_id=30e9f440e31a4fa8b27ec296ec84b4a3)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:30.182077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:30.183887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 185/378] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:30 2022] GET /identity/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:30.190463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:30.303732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af074-98cd-4022-a0aa-57d699f093d5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:30.341059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:30.348985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d98c1-ed56-434a-86ed-e8719fee0d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:30.349633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d98c1-ed56-434a-86ed-e8719fee0d6e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:30.349914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d98c1-ed56-434a-86ed-e8719fee0d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:30.350254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d98c1-ed56-434a-86ed-e8719fee0d6e None admin] PATH_INFO: `/v3/groups/b84d202f1e0849bba57b35a09438d984` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:30.356580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d98c1-ed56-434a-86ed-e8719fee0d6e None admin] RBAC: Authorizing `identity:get_group(group_id=b84d202f1e0849bba57b35a09438d984)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:30.358117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d98c1-ed56-434a-86ed-e8719fee0d6e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:30.360782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 194/379] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:30 2022] GET /identity/v3/groups/b84d202f1e0849bba57b35a09438d984 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:30.367250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:30.513462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6af4e6-8e6a-46ff-b2f8-f4036590ee60 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:30.558504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5aeeb-5065-4c6f-b43c-1065bf6abe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:30.559109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5aeeb-5065-4c6f-b43c-1065bf6abe10 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:30.559385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5aeeb-5065-4c6f-b43c-1065bf6abe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:30.559650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5aeeb-5065-4c6f-b43c-1065bf6abe10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:30.560371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5aeeb-5065-4c6f-b43c-1065bf6abe10 None admin] RBAC: Adding query filter params (group.id=b84d202f1e0849bba57b35a09438d984, role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=30e9f440e31a4fa8b27ec296ec84b4a3) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:30.560669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5aeeb-5065-4c6f-b43c-1065bf6abe10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:30.562989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5aeeb-5065-4c6f-b43c-1065bf6abe10 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:30.570912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 186/380] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:30 2022] GET /identity/v3/role_assignments?group.id=b84d202f1e0849bba57b35a09438d984&scope.project.id=30e9f440e31a4fa8b27ec296ec84b4a3&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:31.261980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd511ef-b1bf-4067-9ee6-4b29578e8d86 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:31.262412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd511ef-b1bf-4067-9ee6-4b29578e8d86 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:31.262589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd511ef-b1bf-4067-9ee6-4b29578e8d86 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:31.264179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 195/381] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:31.273651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879847fb-4fc9-459c-9910-25a3d5ac8086 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:31.273975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879847fb-4fc9-459c-9910-25a3d5ac8086 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:31.274227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879847fb-4fc9-459c-9910-25a3d5ac8086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:31.299451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-879847fb-4fc9-459c-9910-25a3d5ac8086 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:31.300643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-879847fb-4fc9-459c-9910-25a3d5ac8086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:31.315519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:31.379180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b760c-e9a5-4191-8e7a-10648d2bea89 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:31.380116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b760c-e9a5-4191-8e7a-10648d2bea89 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:31.380613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b760c-e9a5-4191-8e7a-10648d2bea89 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:31.384124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 196/382] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:31.388384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96645b5-8cdc-4b99-8155-765e6c2d69ad None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:31.388901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96645b5-8cdc-4b99-8155-765e6c2d69ad None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:31.389467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96645b5-8cdc-4b99-8155-765e6c2d69ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:31.394078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 187/383] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:31.411964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f96645b5-8cdc-4b99-8155-765e6c2d69ad None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:31.413537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f96645b5-8cdc-4b99-8155-765e6c2d69ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:31.504619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 197/384] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:31.756033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879847fb-4fc9-459c-9910-25a3d5ac8086 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:31.847833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96645b5-8cdc-4b99-8155-765e6c2d69ad None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:31.863388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879847fb-4fc9-459c-9910-25a3d5ac8086 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:31.936847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:31.937608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:31.937886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:31.938181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:31.958918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:31.963750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:31.964612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:31.965762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 188/385] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:31.971693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:31.976054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:32.033391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96645b5-8cdc-4b99-8155-765e6c2d69ad None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.094678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:32.108112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:32.109302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.109579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.109848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.129388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:32.134269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:32.135205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:32.136000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:32.138229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d80d20-a0b2-486f-9d42-cc0ea465da6e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.147271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 198/386] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:32.148163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:32.200696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:32.201304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.201586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.201857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.203073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:32.203372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:32.204754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:32.219837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 189/387] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:32.225438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:32.329503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b316038-32ef-4ed2-915f-1dd9fff0665b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.333050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:32.388277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beaa9d-ed8b-4a4a-8e54-bc743896df2c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.389135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02ad80-939a-457f-ab84-eeb0be67ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:32.390741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02ad80-939a-457f-ab84-eeb0be67ca75 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.391975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02ad80-939a-457f-ab84-eeb0be67ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.392399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02ad80-939a-457f-ab84-eeb0be67ca75 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.393209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02ad80-939a-457f-ab84-eeb0be67ca75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:32.393655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02ad80-939a-457f-ab84-eeb0be67ca75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:32.395324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02ad80-939a-457f-ab84-eeb0be67ca75 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:32.406319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 199/388] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:32.407691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91655-08a9-470b-8100-a0afe716e730 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.408073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91655-08a9-470b-8100-a0afe716e730 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.408448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91655-08a9-470b-8100-a0afe716e730 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.409792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 200/389] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:32.414659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91655-08a9-470b-8100-a0afe716e730 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:32.428642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a86ca-777b-4652-8be8-25392ed29410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:32.429819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a86ca-777b-4652-8be8-25392ed29410 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.430287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a86ca-777b-4652-8be8-25392ed29410 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.430729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a86ca-777b-4652-8be8-25392ed29410 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.432544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a86ca-777b-4652-8be8-25392ed29410 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:32.434405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a86ca-777b-4652-8be8-25392ed29410 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:32.437081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 190/390] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:32 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:32.438438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f9122-3bb2-45ad-bbe5-2c45439bff2d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.438710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f9122-3bb2-45ad-bbe5-2c45439bff2d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.439143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f9122-3bb2-45ad-bbe5-2c45439bff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.458999 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-449f9122-3bb2-45ad-bbe5-2c45439bff2d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:32.460404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-449f9122-3bb2-45ad-bbe5-2c45439bff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:32.478821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:32.541926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 191/391] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:32.543071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f9122-3bb2-45ad-bbe5-2c45439bff2d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:32.566271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91655-08a9-470b-8100-a0afe716e730 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.627167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:32.628046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.628509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.628935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.630867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:32.632500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:32.636045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 201/392] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:32 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:32.641540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:32.659263 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:32.723975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f9122-3bb2-45ad-bbe5-2c45439bff2d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.787870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:32.788434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.788711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.788978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.791652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:32.794230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:32.796684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 192/393] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:32 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:32.802469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:32.829211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd51c0-b741-4d13-b4a2-bba70e96f112 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.862461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:32.888119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:32.888835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:32.889115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:32.889388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:32.891623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:32.893418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:32.896237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 202/394] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:32 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:32.897172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:32.959897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6df734-db0a-4c61-9289-4814b169e392 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:32.996907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:33.003327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:33.004027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.004308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.004754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23/groups/0a541b3011ee4e83bec28de0df61892e/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.007062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] RBAC: Authorizing `identity:create_grant(project_id=3077daafa0204db79297f77f460c5c23, group_id=0a541b3011ee4e83bec28de0df61892e, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:33.008496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:33.015127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5acb6-4230-4143-9434-db849b8604d1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:33.022736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 193/395] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Sep 9 14:44:32 2022] PUT /identity/v3/projects/3077daafa0204db79297f77f460c5c23/groups/0a541b3011ee4e83bec28de0df61892e/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:44:33.032169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:33.056187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346937e-4d52-412f-aeb2-bf5b719e5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:33.056745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346937e-4d52-412f-aeb2-bf5b719e5405 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.057095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346937e-4d52-412f-aeb2-bf5b719e5405 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.057287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346937e-4d52-412f-aeb2-bf5b719e5405 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.069572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346937e-4d52-412f-aeb2-bf5b719e5405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c346937e-4d52-412f-aeb2-bf5b719e5405 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:33.075235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:33.076216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:33.077627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 203/396] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:33.079086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d47f-479a-472d-8dde-27f101cb115b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.079086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d47f-479a-472d-8dde-27f101cb115b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.079371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262d47f-479a-472d-8dde-27f101cb115b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.081262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 204/397] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:33.083548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d47f-479a-472d-8dde-27f101cb115b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:33.152297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:33.179420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16ca0e-df71-419d-b7da-70a5dface762 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:33.227555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48702e-6868-46ee-9aff-c2dd97680dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:33.228216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48702e-6868-46ee-9aff-c2dd97680dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.228493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48702e-6868-46ee-9aff-c2dd97680dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.228765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48702e-6868-46ee-9aff-c2dd97680dc4 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23/groups/0a541b3011ee4e83bec28de0df61892e/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.230884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48702e-6868-46ee-9aff-c2dd97680dc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3077daafa0204db79297f77f460c5c23, group_id=0a541b3011ee4e83bec28de0df61892e, role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:33.231367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262d47f-479a-472d-8dde-27f101cb115b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:33.232325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48702e-6868-46ee-9aff-c2dd97680dc4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:33.257931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 194/398] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Sep 9 14:44:33 2022] PUT /identity/v3/projects/3077daafa0204db79297f77f460c5c23/groups/0a541b3011ee4e83bec28de0df61892e/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:33.266905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c209-cb83-42b2-9944-74b44497891b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.268118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c209-cb83-42b2-9944-74b44497891b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.268888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c209-cb83-42b2-9944-74b44497891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.276026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:33.276638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.276914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.277280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.278697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] RBAC: Adding query filter params (name=member) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:33.278697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:33.279946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:33.302122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 205/399] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:33.303723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9212c209-cb83-42b2-9944-74b44497891b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:33.305013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9212c209-cb83-42b2-9944-74b44497891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:33.306300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:33.434141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:33.461480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 195/400] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:33.497317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e5319-12de-4f68-9a9f-3109f1157d94 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:33.505683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:33.536343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf080b-2f36-4c73-821e-553b819b4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:33.537122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf080b-2f36-4c73-821e-553b819b4bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.537403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf080b-2f36-4c73-821e-553b819b4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.537714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf080b-2f36-4c73-821e-553b819b4bd8 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.538350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a889-ccbb-44ef-ad82-3f337a62d940 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.538637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a889-ccbb-44ef-ad82-3f337a62d940 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.538859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf080b-2f36-4c73-821e-553b819b4bd8 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:33.538958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758a889-ccbb-44ef-ad82-3f337a62d940 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.540361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf080b-2f36-4c73-821e-553b819b4bd8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:33.540480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 196/401] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:33.541910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 206/402] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:33 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:33.548411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a889-ccbb-44ef-ad82-3f337a62d940 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:33.551102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbfc3-14b6-45ab-bc30-671e939eef42 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.551388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbfc3-14b6-45ab-bc30-671e939eef42 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.551660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fbfc3-14b6-45ab-bc30-671e939eef42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.575302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1e1fbfc3-14b6-45ab-bc30-671e939eef42 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:33.576794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1e1fbfc3-14b6-45ab-bc30-671e939eef42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:33.698907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758a889-ccbb-44ef-ad82-3f337a62d940 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:33.738205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 207/403] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:33.765497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:33.766225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.766501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.766769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.767909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:33.769394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:33.772207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 197/404] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:33 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:33.776782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fbfc3-14b6-45ab-bc30-671e939eef42 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:33.816131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:33.892809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:33.945019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fbfc3-14b6-45ab-bc30-671e939eef42 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:33.947439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:33.988824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:33.989509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:33.989789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:33.990059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a/groups/0a541b3011ee4e83bec28de0df61892e/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:33.994226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87b28f-838c-46f0-94bf-6114f16209f4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:33.996455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c4af6068fd4ce790197475c719687a, group_id=0a541b3011ee4e83bec28de0df61892e, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:33.998480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:34.026321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 208/405] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Sep 9 14:44:33 2022] PUT /identity/v3/projects/b2c4af6068fd4ce790197475c719687a/groups/0a541b3011ee4e83bec28de0df61892e/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:34.042607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:34.043305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:34.043590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:34.043925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:34.056216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:34.061993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:34.063065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:34.063857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 198/406] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:34.069378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:34.133417 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:34.248085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f45ae-50d7-4731-85e7-a052edf574e9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:34.276914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2e71c-0f10-4d73-b6fb-2a7dd5f0a3a0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:34.289158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:34.289770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:34.290050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:34.290351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:34.291017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:34.291188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:34.291683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:34.293409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:34.304536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 209/407] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:34.310628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:34.321976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:34.322637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:34.322911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:34.323229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:34.335577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:34.341229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:34.343848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:34.345803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 199/408] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:34.349731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:34.371301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:34.516162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df765c-fb4d-482f-a55d-874b0dab5664 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:34.526473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9979ab-930b-4587-a121-4d69d158d99d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:34.578447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:34.579404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:34.579927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:34.580396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:34.581252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:34.582005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:34.584459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:34.587953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:34.588598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:34.588929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:34.589210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:34.592363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:34.594583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:34.596277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 210/409] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:34 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:34.596685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 200/410] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:34.601890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:34.602869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:34.659696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:34.773952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:34.780888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b5748-75cc-4ba0-9710-b65fef5a5a5e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:34.786836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ec29-0d82-4e03-80d6-a7d09e7d7f02 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:34.848740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:34.849386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:34.849666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:34.849936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] PATH_INFO: `/v3/groups/b84d202f1e0849bba57b35a09438d984` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:34.854024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:34.854772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] RBAC: Authorizing `identity:get_group(group_id=b84d202f1e0849bba57b35a09438d984)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:34.855140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:34.855622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:34.856082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:34.856258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:34.857556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:34.860390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:34.862171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 201/411] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:34 2022] GET /identity/v3/groups/b84d202f1e0849bba57b35a09438d984 => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:34.862535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 211/412] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:34 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:34.864233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:34.868084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:35.016049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb840c-685c-4c61-8914-f9c8d36c1680 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:35.039233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:35.043792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dfbf1b-a9c1-4867-8c16-f499a172f57a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:35.082834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2e67-5b23-4ac8-9783-d3f8ae3bbd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:35.083508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2e67-5b23-4ac8-9783-d3f8ae3bbd29 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:35.083789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2e67-5b23-4ac8-9783-d3f8ae3bbd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:35.084068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2e67-5b23-4ac8-9783-d3f8ae3bbd29 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a/groups/0a541b3011ee4e83bec28de0df61892e/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:35.088695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2e67-5b23-4ac8-9783-d3f8ae3bbd29 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2c4af6068fd4ce790197475c719687a, group_id=0a541b3011ee4e83bec28de0df61892e, role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:35.090810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2e67-5b23-4ac8-9783-d3f8ae3bbd29 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:35.097874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:35.098961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:35.099572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:35.100017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] PATH_INFO: `/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:35.101256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] RBAC: Authorizing `identity:get_project(project_id=30e9f440e31a4fa8b27ec296ec84b4a3)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:35.103092 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:35.105543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 202/413] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:34 2022] GET /identity/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3 => generated 344 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:35.111617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:35.112688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 212/414] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Sep 9 14:44:34 2022] PUT /identity/v3/projects/b2c4af6068fd4ce790197475c719687a/groups/0a541b3011ee4e83bec28de0df61892e/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:35.254395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec90c-80f0-4531-8fa9-11427652acf0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:35.308834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14374-6f23-430b-9817-afdcf1b73ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:35.309437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14374-6f23-430b-9817-afdcf1b73ede None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:35.309782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14374-6f23-430b-9817-afdcf1b73ede None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:35.310061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14374-6f23-430b-9817-afdcf1b73ede None admin] PATH_INFO: `/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3/groups/b84d202f1e0849bba57b35a09438d984/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:35.314504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14374-6f23-430b-9817-afdcf1b73ede None admin] RBAC: Authorizing `identity:create_grant(project_id=30e9f440e31a4fa8b27ec296ec84b4a3, group_id=b84d202f1e0849bba57b35a09438d984, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:35.315985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14374-6f23-430b-9817-afdcf1b73ede None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:35.335752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 203/415] 10.222.0.52 () {58 vars in 1442 bytes} [Fri Sep 9 14:44:35 2022] PUT /identity/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3/groups/b84d202f1e0849bba57b35a09438d984/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:35.573326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221030-15d9-4dad-83ef-d4203387930d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:35.573806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221030-15d9-4dad-83ef-d4203387930d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:35.573806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6221030-15d9-4dad-83ef-d4203387930d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:35.575513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 213/416] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:35.582617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ba696-6e2c-4808-b99f-2fa6a5856c80 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:35.583057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ba696-6e2c-4808-b99f-2fa6a5856c80 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:35.583239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ba696-6e2c-4808-b99f-2fa6a5856c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:35.602078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-008ba696-6e2c-4808-b99f-2fa6a5856c80 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:35.603280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-008ba696-6e2c-4808-b99f-2fa6a5856c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:35.628004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:35.682216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 204/417] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:36.077591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827aca-3efc-473c-b6ac-c495e65313a1 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.078150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827aca-3efc-473c-b6ac-c495e65313a1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.078630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827aca-3efc-473c-b6ac-c495e65313a1 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.080416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 214/418] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:36.085798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350a72-9426-44c5-833d-d4d8cb6a66ce None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.086308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350a72-9426-44c5-833d-d4d8cb6a66ce None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.086760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a350a72-9426-44c5-833d-d4d8cb6a66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.106470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827aca-3efc-473c-b6ac-c495e65313a1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:36.115154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-5a350a72-9426-44c5-833d-d4d8cb6a66ce None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:36.116734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5a350a72-9426-44c5-833d-d4d8cb6a66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:36.149876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:36.236526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 205/419] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:36.270349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827aca-3efc-473c-b6ac-c495e65313a1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:36.307486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:36.308456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.308918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.309386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.322133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:36.328074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:36.329045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:36.329852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:36.332311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 215/420] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:36.338551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a350a72-9426-44c5-833d-d4d8cb6a66ce None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:36.463094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:36.475796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a350a72-9426-44c5-833d-d4d8cb6a66ce None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:36.510654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:36.511254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.511532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.511799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.512452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:36.512745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:36.514118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:36.523284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 206/421] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:36.529070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:36.603294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:36.642793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:36.663669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d573e2-7516-4789-9d62-0e173c67b23e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:36.703578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9938a6-5b9c-46cc-be34-f71025c011eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:36.704270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9938a6-5b9c-46cc-be34-f71025c011eb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.704602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9938a6-5b9c-46cc-be34-f71025c011eb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.705081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9938a6-5b9c-46cc-be34-f71025c011eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.751349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b583a-f132-47c6-a94b-75522ea28463 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:36.785847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9938a6-5b9c-46cc-be34-f71025c011eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:36.787395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9938a6-5b9c-46cc-be34-f71025c011eb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:36.787719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a48cdb-0a19-42a4-bb9d-929b84dbea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:36.788522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a48cdb-0a19-42a4-bb9d-929b84dbea37 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.788941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a48cdb-0a19-42a4-bb9d-929b84dbea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.789352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a48cdb-0a19-42a4-bb9d-929b84dbea37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.802253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a48cdb-0a19-42a4-bb9d-929b84dbea37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-91a48cdb-0a19-42a4-bb9d-929b84dbea37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:36.808228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:36.809284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:36.810242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:36.811334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 207/422] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:36.812547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873672-5b8e-4b78-bdd5-a87dae66020f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.812829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873672-5b8e-4b78-bdd5-a87dae66020f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.813098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873672-5b8e-4b78-bdd5-a87dae66020f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.814350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 208/423] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:36.819745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31873672-5b8e-4b78-bdd5-a87dae66020f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:36.835076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:36.880210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:36.901125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 216/424] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:36.902756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcca19-5b1f-4920-8c37-b325e0b26da2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.903245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcca19-5b1f-4920-8c37-b325e0b26da2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.903707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcca19-5b1f-4920-8c37-b325e0b26da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.922978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b1bcca19-5b1f-4920-8c37-b325e0b26da2 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:36.924434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b1bcca19-5b1f-4920-8c37-b325e0b26da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:36.944643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31873672-5b8e-4b78-bdd5-a87dae66020f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:36.985211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:36.985900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:36.986272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:36.986604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:36.987474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:36.987879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:36.989421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:36.995749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 217/425] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:36.997087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcca19-5b1f-4920-8c37-b325e0b26da2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.006170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 209/426] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:37.013199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.154173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcca19-5b1f-4920-8c37-b325e0b26da2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:37.162414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:37.184066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:37.217846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cc104-1bf7-4563-a4ff-e56d6f276fdc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:37.226606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:37.227243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.227520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.227787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.229538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:37.231018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:37.232984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 218/427] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:36 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:37.238515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.287900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:37.288919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.289430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.289925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.363591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:37.365412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:37.401554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf0de-7763-4c5f-a24f-0fb1fd51cf26 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:37.443146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:37.449290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:37.449926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.450224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.450492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.452749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:37.454226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:37.458245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 219/428] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:37 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:37.459253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.492319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 210/429] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:37.493491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.515510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:37.570108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8ea32-fa85-42e7-bef6-d222d5a682da None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:37.610880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:37.611550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.611828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.612097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.614455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c62c2-e5a8-4196-9982-6e2c4da5dffd None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:37.624177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:37.629162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:37.630027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:37.630836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 220/430] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:37.631483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.659923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:37.660525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.660802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.661065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.661780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=3077daafa0204db79297f77f460c5c23) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:37.662079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:37.663986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:37.678728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 211/431] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:37 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:37.679695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.743956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:37.763956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75d05-5937-4769-a9de-c43a8c7a2592 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:37.777997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:37.818721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0adc74-6fa0-4869-a941-5cd646720317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:37.819608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0adc74-6fa0-4869-a941-5cd646720317 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.819888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0adc74-6fa0-4869-a941-5cd646720317 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.820160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0adc74-6fa0-4869-a941-5cd646720317 None admin] PATH_INFO: `/v3/projects/3077daafa0204db79297f77f460c5c23` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.822162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0adc74-6fa0-4869-a941-5cd646720317 None admin] RBAC: Authorizing `identity:get_project(project_id=3077daafa0204db79297f77f460c5c23)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:37.823931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0adc74-6fa0-4869-a941-5cd646720317 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:37.826737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 221/432] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:37 2022] GET /identity/v3/projects/3077daafa0204db79297f77f460c5c23 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:37.828499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952d315-1099-4a59-8023-f394b55eeabb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:37.828684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec2ea-08b5-416d-af06-acfd5de9e052 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.828964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec2ea-08b5-416d-af06-acfd5de9e052 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.829236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec2ea-08b5-416d-af06-acfd5de9e052 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.830545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 222/433] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:37.836714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaec2ea-08b5-416d-af06-acfd5de9e052 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:37.876460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732275f-021b-4d69-91e5-26615c0bcf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:37.877627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732275f-021b-4d69-91e5-26615c0bcf3b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.877903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732275f-021b-4d69-91e5-26615c0bcf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.878904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732275f-021b-4d69-91e5-26615c0bcf3b None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.879582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732275f-021b-4d69-91e5-26615c0bcf3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:37.879883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732275f-021b-4d69-91e5-26615c0bcf3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:37.881268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732275f-021b-4d69-91e5-26615c0bcf3b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:37.890931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 212/434] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:37.892201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0937-6461-457a-8f97-b3feea07c70b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:37.892499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0937-6461-457a-8f97-b3feea07c70b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:37.892774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0937-6461-457a-8f97-b3feea07c70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:37.915005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-33aa0937-6461-457a-8f97-b3feea07c70b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:37.916255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-33aa0937-6461-457a-8f97-b3feea07c70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:37.970179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaec2ea-08b5-416d-af06-acfd5de9e052 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.003945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 213/435] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:38.005209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0937-6461-457a-8f97-b3feea07c70b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.021353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0a7bc-bd44-402e-84ed-eff2c2bbc9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.021353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0a7bc-bd44-402e-84ed-eff2c2bbc9af None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.021353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0a7bc-bd44-402e-84ed-eff2c2bbc9af None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.021353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0a7bc-bd44-402e-84ed-eff2c2bbc9af None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.024760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0a7bc-bd44-402e-84ed-eff2c2bbc9af None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:38.026278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0a7bc-bd44-402e-84ed-eff2c2bbc9af None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:38.031934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 223/436] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:37 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:38.031934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242283d-775a-4c65-b5bd-23aa39a800e2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.031934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242283d-775a-4c65-b5bd-23aa39a800e2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.031934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242283d-775a-4c65-b5bd-23aa39a800e2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.031934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 224/437] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:38.035810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242283d-775a-4c65-b5bd-23aa39a800e2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.048605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.093629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.156707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0937-6461-457a-8f97-b3feea07c70b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.160530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242283d-775a-4c65-b5bd-23aa39a800e2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.203443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.204100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.204380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.204653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.211273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16973e-e192-4259-ba5b-df1b0202d6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.211419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16973e-e192-4259-ba5b-df1b0202d6ba None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.211703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16973e-e192-4259-ba5b-df1b0202d6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.211973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16973e-e192-4259-ba5b-df1b0202d6ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.212695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16973e-e192-4259-ba5b-df1b0202d6ba None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=3077daafa0204db79297f77f460c5c23) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:38.213002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16973e-e192-4259-ba5b-df1b0202d6ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:38.214500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16973e-e192-4259-ba5b-df1b0202d6ba None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:38.224608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 225/438] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=3077daafa0204db79297f77f460c5c23&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:38.225359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193a07c-6024-45de-9dc2-2748db110746 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.225660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193a07c-6024-45de-9dc2-2748db110746 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.225981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193a07c-6024-45de-9dc2-2748db110746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.256003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9193a07c-6024-45de-9dc2-2748db110746 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:38.257890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9193a07c-6024-45de-9dc2-2748db110746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:38.290866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:38.292717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:38.324798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.351160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 226/439] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:38.354321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193a07c-6024-45de-9dc2-2748db110746 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.407047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.416585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 214/440] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:38.423127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.484456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193a07c-6024-45de-9dc2-2748db110746 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.528524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.528845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.529066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.529338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.545053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:38.547914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0353af-f518-4b75-ade8-64c33fec566d None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:38.550678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:38.551594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:38.552409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 227/441] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:38.557499 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.587076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.596163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.597046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.597322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.597589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.598878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:38.601138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:38.603431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 215/442] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:38.610153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.672564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.677982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de1174-6bdf-4504-9e73-1c5d7b38dc7f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.722862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.723464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.723735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.724004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.724656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:38.724949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:38.726328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:38.732295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e655c5-61ed-4b36-ba9d-69497c199805 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.734848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 228/443] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:38.735575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.767319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.767944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.768222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.768498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.769613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:38.771089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:38.772647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 216/444] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:38.773402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.834687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.838049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64f0cf-a92d-46cc-9b43-de932e59ba46 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.870713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.871280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675f2e4-0a96-4027-8a82-8917a46cd10b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:38.871388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.871673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.871950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.882514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:38.887738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:38.888612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:38.890054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 229/445] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:38.891062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:38.909259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:38.909858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:38.910159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:38.910432 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:38.911387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:38.978521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:38.979974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:38.991037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7005602-945b-4d6f-8514-65502cb82c64 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.024244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.024837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.025111 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.025381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.026110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=b60e4f6e616d4b0bb7f4522d885667be, scope.project.id=b2c4af6068fd4ce790197475c719687a) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:39.026425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.027838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.034549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 230/446] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=b60e4f6e616d4b0bb7f4522d885667be => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:39.042429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:39.043017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.086311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 217/447] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:39.092172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.143881 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:39.162835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b02b53-93a6-46ed-8543-f6c0eef1a631 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.201820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.203644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.203922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.204189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.204856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:39.205151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.206555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.214965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd28bf-a79d-45cd-9a1e-c910284991fb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.217118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 231/448] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:39.223408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.254843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.255635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.255635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.255906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] PATH_INFO: `/v3/projects/b2c4af6068fd4ce790197475c719687a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.257035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] RBAC: Authorizing `identity:get_project(project_id=b2c4af6068fd4ce790197475c719687a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.259293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.261806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 218/449] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/projects/b2c4af6068fd4ce790197475c719687a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:39.266934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.305426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:39.346745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954edf8b-ccfa-4272-8ffa-866c2fc0bb79 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.387794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.388399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.388679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.388939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.390603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecc946-000e-413e-add8-ea30497d9594 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.406629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:39.434722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.435349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.435625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.435915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] PATH_INFO: `/v3/groups/0a541b3011ee4e83bec28de0df61892e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.437118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] RBAC: Authorizing `identity:get_group(group_id=0a541b3011ee4e83bec28de0df61892e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.438630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.440359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 219/450] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/groups/0a541b3011ee4e83bec28de0df61892e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:39.445957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.466163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.468304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.540941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:39.544241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b249c4f-eaa5-4eca-86fa-0268eaf9a3a5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.567391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 232/451] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 14:44:39.572891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.578738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.579343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.579623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.579895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.580621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] RBAC: Adding query filter params (group.id=0a541b3011ee4e83bec28de0df61892e, role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=b2c4af6068fd4ce790197475c719687a) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:39.580927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.582648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.588273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 220/452] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/role_assignments?group.id=0a541b3011ee4e83bec28de0df61892e&scope.project.id=b2c4af6068fd4ce790197475c719687a&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:39.621771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:39.679296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8792862-17b0-4263-a478-c5b338bf8a32 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.716404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.717041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.717313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.718236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] PATH_INFO: `/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.719729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=30e9f440e31a4fa8b27ec296ec84b4a3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.721155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.722836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 233/453] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/projects/30e9f440e31a4fa8b27ec296ec84b4a3 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:39.728469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.830692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e889765-7829-43bc-a208-231f3468b46e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.864086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a70c15-ab60-4d86-88a8-605c1d013536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:39.864715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70c15-ab60-4d86-88a8-605c1d013536 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:39.864993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70c15-ab60-4d86-88a8-605c1d013536 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:39.865266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a70c15-ab60-4d86-88a8-605c1d013536 None admin] PATH_INFO: `/v3/groups/b84d202f1e0849bba57b35a09438d984` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:39.866401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a70c15-ab60-4d86-88a8-605c1d013536 None admin] RBAC: Authorizing `identity:get_group(group_id=b84d202f1e0849bba57b35a09438d984)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:39.867830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a70c15-ab60-4d86-88a8-605c1d013536 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:39.869382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 221/454] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/groups/b84d202f1e0849bba57b35a09438d984 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:39.875562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:39.977409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85622b-a418-4107-b9d9-3a2b6e462aa9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:39.991049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:40.011727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962295b4-4e41-46a7-bf9b-ff342c578b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:40.012317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962295b4-4e41-46a7-bf9b-ff342c578b6b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:40.012593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962295b4-4e41-46a7-bf9b-ff342c578b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:40.012862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962295b4-4e41-46a7-bf9b-ff342c578b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:40.013574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962295b4-4e41-46a7-bf9b-ff342c578b6b None admin] RBAC: Adding query filter params (group.id=b84d202f1e0849bba57b35a09438d984, role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=30e9f440e31a4fa8b27ec296ec84b4a3) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:40.013877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962295b4-4e41-46a7-bf9b-ff342c578b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:40.015934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962295b4-4e41-46a7-bf9b-ff342c578b6b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:40.021540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 234/455] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Sep 9 14:44:39 2022] GET /identity/v3/role_assignments?group.id=b84d202f1e0849bba57b35a09438d984&scope.project.id=30e9f440e31a4fa8b27ec296ec84b4a3&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:42.543785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b1380-ab07-49d9-974e-db3e6c333b1b None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:42.544302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b1380-ab07-49d9-974e-db3e6c333b1b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:42.544302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b1380-ab07-49d9-974e-db3e6c333b1b None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:42.545945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 222/456] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:42.551552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba845b7-6508-461b-86a8-5f282b5ed90c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:42.552366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba845b7-6508-461b-86a8-5f282b5ed90c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:42.552830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba845b7-6508-461b-86a8-5f282b5ed90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:42.579009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-dba845b7-6508-461b-86a8-5f282b5ed90c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:42.580555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dba845b7-6508-461b-86a8-5f282b5ed90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:42.678478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 235/457] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:42.998008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b1380-ab07-49d9-974e-db3e6c333b1b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:43.026690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa776b-a9f4-47e3-a33c-45850858f327 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.027315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa776b-a9f4-47e3-a33c-45850858f327 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.027778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa776b-a9f4-47e3-a33c-45850858f327 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.029687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 236/458] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:43.036030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7dfd-711b-4556-8cee-7332467f5908 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.036315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7dfd-711b-4556-8cee-7332467f5908 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.036590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7dfd-711b-4556-8cee-7332467f5908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.041037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:43.064724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4fad7dfd-711b-4556-8cee-7332467f5908 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:43.066104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4fad7dfd-711b-4556-8cee-7332467f5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:43.135940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b1380-ab07-49d9-974e-db3e6c333b1b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:43.162185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 237/459] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:43.163490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136fef-1009-4aa1-8108-eff7f386242a None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.163774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136fef-1009-4aa1-8108-eff7f386242a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.164054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37136fef-1009-4aa1-8108-eff7f386242a None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.165314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 238/460] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:43.173019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e026f-8d93-42c3-81a2-a8f69a551595 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.173302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e026f-8d93-42c3-81a2-a8f69a551595 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.173576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e026f-8d93-42c3-81a2-a8f69a551595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.195659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:43.196289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.196564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.196833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.209548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-896e026f-8d93-42c3-81a2-a8f69a551595 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:43.212160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-896e026f-8d93-42c3-81a2-a8f69a551595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:43.220488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:43.221941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:43.241573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:43.242529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:43.243357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:43.243357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:43.243357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:43.243357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 223/461] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:43.251103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:43.271020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:43.345585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 239/462] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:43.401817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:43.419539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a16a8-a3da-45b6-9961-7c91a43043df None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:43.470420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:43.471021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.471296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.471563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.472193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:43.472491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:43.473904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:43.491916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 224/463] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:43.494120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e026f-8d93-42c3-81a2-a8f69a551595 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:43.497319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:43.609645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e026f-8d93-42c3-81a2-a8f69a551595 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:43.627098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fbe4f-2b28-41e7-82c3-88e9c331778f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:43.645862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9dff1-c555-4880-ac49-03009d29de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:43.646513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9dff1-c555-4880-ac49-03009d29de98 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.646782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9dff1-c555-4880-ac49-03009d29de98 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.647051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9dff1-c555-4880-ac49-03009d29de98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.658325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9dff1-c555-4880-ac49-03009d29de98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:43.659787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9dff1-c555-4880-ac49-03009d29de98 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:43.664006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:43.664611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.664887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.665154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.665795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:43.667252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c7f9dff1-c555-4880-ac49-03009d29de98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:43.674861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:43.675786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:43.676628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:43.676628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:43.676628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:43.676628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 240/464] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:43.677526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2518c27-602a-4a83-9413-14c469bd0fbd None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.677817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2518c27-602a-4a83-9413-14c469bd0fbd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.678105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2518c27-602a-4a83-9413-14c469bd0fbd None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.679573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 241/465] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:43.680266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2518c27-602a-4a83-9413-14c469bd0fbd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:43.692066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:43.697721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 225/466] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:43 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:44:43.698850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:43.726605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:43.828732 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de6258-bbcc-4929-801d-e6438e25085b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:43.852911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2518c27-602a-4a83-9413-14c469bd0fbd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:43.869190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52c829-dbcf-470c-b3ba-2fb335b43ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:43.869861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52c829-dbcf-470c-b3ba-2fb335b43ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.870397 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52c829-dbcf-470c-b3ba-2fb335b43ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.870639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52c829-dbcf-470c-b3ba-2fb335b43ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.871640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52c829-dbcf-470c-b3ba-2fb335b43ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:43.871992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52c829-dbcf-470c-b3ba-2fb335b43ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:43.873453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52c829-dbcf-470c-b3ba-2fb335b43ff3 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:43.887363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 226/467] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:43.889729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390eac-f9f7-4f64-b5cc-e57b8e8b57e4 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.890009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390eac-f9f7-4f64-b5cc-e57b8e8b57e4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.890496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17390eac-f9f7-4f64-b5cc-e57b8e8b57e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.908320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:43.908959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:43.909236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:43.909501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:43.913212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-17390eac-f9f7-4f64-b5cc-e57b8e8b57e4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:43.914731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-17390eac-f9f7-4f64-b5cc-e57b8e8b57e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:43.922830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:43.924212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:43.938853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:43.939805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:43.940647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:43.940647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:43.940647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:43.940647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 242/468] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:43.941016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:43.990683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:44.018165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 227/469] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:44.018165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17390eac-f9f7-4f64-b5cc-e57b8e8b57e4 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:44.057711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:44.113331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635481b5-d18b-422d-babc-f1efb1737318 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:44.179485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5917fb5-5a13-4bf1-b1a7-525499105f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:44.180118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5917fb5-5a13-4bf1-b1a7-525499105f2a None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.180395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5917fb5-5a13-4bf1-b1a7-525499105f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.180664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5917fb5-5a13-4bf1-b1a7-525499105f2a None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.181333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5917fb5-5a13-4bf1-b1a7-525499105f2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:44.182867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5917fb5-5a13-4bf1-b1a7-525499105f2a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:44.227521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17390eac-f9f7-4f64-b5cc-e57b8e8b57e4 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:44.228995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 243/470] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:43 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:44:44.275173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:44.276108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.276577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.277020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.277874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:44.278375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:44.280594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:44.299982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 228/471] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:44.303369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66551c-6667-49f0-a453-a48682fd8a24 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.303653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66551c-6667-49f0-a453-a48682fd8a24 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.303997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66551c-6667-49f0-a453-a48682fd8a24 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.305428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 244/472] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:44.306294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:44.311014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8beee-819d-401a-9f38-6954bca99bb0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.311547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8beee-819d-401a-9f38-6954bca99bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.311817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8beee-819d-401a-9f38-6954bca99bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.355003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6cb8beee-819d-401a-9f38-6954bca99bb0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:44.361170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6cb8beee-819d-401a-9f38-6954bca99bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:44.390922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:44.461560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 245/473] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:44.462187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8beee-819d-401a-9f38-6954bca99bb0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:44.472394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cdd79-c757-4036-af92-4381192bb595 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:44.524826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:44.526437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.526923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.527414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.528267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:44.531284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:44.536140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:44.568877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 229/474] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:44 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:44:44.595860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8beee-819d-401a-9f38-6954bca99bb0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:44.636527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:44.637160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.637441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.637704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.649818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:44.651407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:44.669408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:44.670544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:44.671910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:44.671910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:44.671910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:44.671910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 246/475] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:44.677868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:44.758462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:44.832695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c3b85-359e-42d9-8e46-d4e9a43c13f3 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:44.842126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:44.882598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:44.883219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.883753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.884031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.884678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:44.884978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:44.886605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:44.898300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cac6fb-9b31-4cd6-8636-0270a8555658 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:44.902048 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 230/476] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:44.906929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:44.919731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:44.939541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:44.940146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:44.940418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:44.940685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:44.941360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:44.942768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:44.951025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.sql.core [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 14:44:44.951025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 14:44:44.951025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [parameters: {'id': 'd3f70b4721ad446b9fe4905662f24416', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 14:44:44.951025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81510) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Sep 09 14:44:44.971095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 14:44:44.971985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application yield resource Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application next(self.gen) Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise self.value Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application session.commit() Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 14:44:44.972869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.session.flush() Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application compat.raise_( Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 14:44:44.973705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 14:44:44.974596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application conn.query(q) Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application result.read() Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 14:44:44.975414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [parameters: {'id': 'd3f70b4721ad446b9fe4905662f24416', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:44.976159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 14:44:44.976932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:44.977765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 247/477] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Sep 9 14:44:44 2022] POST /identity/v3/roles => generated 144 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:44.979169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:45.033508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c8952-0870-47b6-9cd8-aab3b8605784 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:45.105792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffc308-6d14-47d7-a449-a96cd2663f42 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:45.106796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:45.107477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:45.107762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:45.108572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:45.109238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:45.110701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:45.144942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e803c70-eade-47b2-bc1a-d445c5247fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:45.145911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803c70-eade-47b2-bc1a-d445c5247fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:45.146406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803c70-eade-47b2-bc1a-d445c5247fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:45.146884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e803c70-eade-47b2-bc1a-d445c5247fe9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:45.150737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 231/478] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:44 2022] POST /identity/v3/users => generated 249 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:44:45.164262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e803c70-eade-47b2-bc1a-d445c5247fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-2e803c70-eade-47b2-bc1a-d445c5247fe9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:45.170181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:45.172165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 14:44:45.172972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:45.179761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 248/479] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:44:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:45.186957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:45.224752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:45.323719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519acb0-12b6-42a5-a09a-f629ae9b4359 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:45.374887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d9c52-30f6-4395-b142-7d320f5f7fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:45.375490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d9c52-30f6-4395-b142-7d320f5f7fdc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:45.375767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d9c52-30f6-4395-b142-7d320f5f7fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:45.376031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d9c52-30f6-4395-b142-7d320f5f7fdc None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:45.376691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d9c52-30f6-4395-b142-7d320f5f7fdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:45.376988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d9c52-30f6-4395-b142-7d320f5f7fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:45.378483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d9c52-30f6-4395-b142-7d320f5f7fdc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:45.390275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 232/480] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:46.247150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e6518-c9e1-4444-9673-64397a141ecd None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:46.247660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e6518-c9e1-4444-9673-64397a141ecd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:46.247660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e6518-c9e1-4444-9673-64397a141ecd None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:46.249431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 249/481] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:46.254582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e3e97-33d9-4200-bd05-d8100b609274 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:46.254971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e3e97-33d9-4200-bd05-d8100b609274 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:46.255133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e3e97-33d9-4200-bd05-d8100b609274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:46.273780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-947e3e97-33d9-4200-bd05-d8100b609274 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:46.274983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-947e3e97-33d9-4200-bd05-d8100b609274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:46.372726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 233/482] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:46.701794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e6518-c9e1-4444-9673-64397a141ecd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:46.751567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:46.844267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e6518-c9e1-4444-9673-64397a141ecd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:46.891713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:46.892346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:46.892622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:46.892892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:46.909093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:46.913918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:46.914814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:46.915630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:46.919461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 250/483] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:46.921627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e3e97-33d9-4200-bd05-d8100b609274 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:46.941694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:47.060928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e3e97-33d9-4200-bd05-d8100b609274 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:47.114461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf5635-262c-4605-9ead-b2d86f9c9ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:47.115068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5635-262c-4605-9ead-b2d86f9c9ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.115347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5635-262c-4605-9ead-b2d86f9c9ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.115616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf5635-262c-4605-9ead-b2d86f9c9ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.116276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5635-262c-4605-9ead-b2d86f9c9ce4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:47.116575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5635-262c-4605-9ead-b2d86f9c9ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:47.117929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf5635-262c-4605-9ead-b2d86f9c9ce4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:47.130042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 234/484] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:47.135551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:47.203010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989418c-bd8e-43f4-ba40-5cb4cafc67d5 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.203340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989418c-bd8e-43f4-ba40-5cb4cafc67d5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.203616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989418c-bd8e-43f4-ba40-5cb4cafc67d5 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.205207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 235/485] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:47.210477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b39ee-dd6e-47d3-b245-59df398e00b3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.210757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b39ee-dd6e-47d3-b245-59df398e00b3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.211025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b39ee-dd6e-47d3-b245-59df398e00b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.230011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-330b39ee-dd6e-47d3-b245-59df398e00b3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:47.231973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-330b39ee-dd6e-47d3-b245-59df398e00b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:47.300200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:47.310037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ce300-4ed6-4d04-801c-f50133e94c79 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:47.347905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 236/486] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:47.355110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:47.355834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.356184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.356524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.367782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:47.369411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:47.385676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:47.386612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:47.387468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:47.387468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:47.387468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:47.387468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 251/487] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:47.393427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b39ee-dd6e-47d3-b245-59df398e00b3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:47.406520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:47.532350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b39ee-dd6e-47d3-b245-59df398e00b3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:47.585110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d389f-da45-4890-8e1d-37e4bc0bb878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:47.585715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d389f-da45-4890-8e1d-37e4bc0bb878 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.585987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d389f-da45-4890-8e1d-37e4bc0bb878 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.586284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d389f-da45-4890-8e1d-37e4bc0bb878 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.586931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d389f-da45-4890-8e1d-37e4bc0bb878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:47.587229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d389f-da45-4890-8e1d-37e4bc0bb878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:47.588584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d389f-da45-4890-8e1d-37e4bc0bb878 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:47.604494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 237/488] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:47.610248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:47.651545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350019bc-00fe-444d-973f-5420d79f2311 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.651851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350019bc-00fe-444d-973f-5420d79f2311 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.652087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350019bc-00fe-444d-973f-5420d79f2311 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.653424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 238/489] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:47.671894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896edb9-1df7-453e-a6d7-aeb1e964a7e3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.672472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896edb9-1df7-453e-a6d7-aeb1e964a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.672936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896edb9-1df7-453e-a6d7-aeb1e964a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.717773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9896edb9-1df7-453e-a6d7-aeb1e964a7e3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:47.719377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9896edb9-1df7-453e-a6d7-aeb1e964a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:47.733320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a4952-bb78-4927-906c-0640f8b60991 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:47.770564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:47.771370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:47.771651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:47.772627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:47.789644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:47.791125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:47.816744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:47.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:47.818637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 252/490] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:44:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:47.823545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:47.836862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:47.837820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:47.850100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 239/491] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:47.879051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896edb9-1df7-453e-a6d7-aeb1e964a7e3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.018571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896edb9-1df7-453e-a6d7-aeb1e964a7e3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.030581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d042dd-0f32-4001-99c6-db5cbe5a7ccf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.057703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.058357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.058633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.058898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.079187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:48.084467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:48.085386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:48.086270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 240/492] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:48.092312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.097353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a47d5-5258-4046-9d0a-70f0e33d5fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.098392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a47d5-5258-4046-9d0a-70f0e33d5fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.098871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a47d5-5258-4046-9d0a-70f0e33d5fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.099340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a47d5-5258-4046-9d0a-70f0e33d5fc1 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.100312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a47d5-5258-4046-9d0a-70f0e33d5fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:48.100834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a47d5-5258-4046-9d0a-70f0e33d5fc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:48.102609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a47d5-5258-4046-9d0a-70f0e33d5fc1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:48.143265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 253/493] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:44:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:48.146267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346e310-2426-49c3-b9e8-48bc1c69c8f8 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.146267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346e310-2426-49c3-b9e8-48bc1c69c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.146267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346e310-2426-49c3-b9e8-48bc1c69c8f8 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.150130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 254/494] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:48.150130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346e310-2426-49c3-b9e8-48bc1c69c8f8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.166123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.216214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d683a-c5b7-40af-913b-74cee14a7a05 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.219135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.251974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.252574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.252851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.253118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.253777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:48.254097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:48.255470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:48.260624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346e310-2426-49c3-b9e8-48bc1c69c8f8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.263106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 241/495] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:48.263880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.294975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41468f-e55d-40aa-8dfa-9cc0a0f6640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.296336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41468f-e55d-40aa-8dfa-9cc0a0f6640a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.296740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41468f-e55d-40aa-8dfa-9cc0a0f6640a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.297010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41468f-e55d-40aa-8dfa-9cc0a0f6640a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.307063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41468f-e55d-40aa-8dfa-9cc0a0f6640a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-2a41468f-e55d-40aa-8dfa-9cc0a0f6640a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:48.312089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:48.313011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:48.313823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 255/496] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:48.314504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cc54-8cd6-4bf3-bc70-95c7731623a3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.314568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cc54-8cd6-4bf3-bc70-95c7731623a3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.314801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cc54-8cd6-4bf3-bc70-95c7731623a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.332218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d0e9cc54-8cd6-4bf3-bc70-95c7731623a3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:48.333385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d0e9cc54-8cd6-4bf3-bc70-95c7731623a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:48.372108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14099105-a3c9-4661-b6ec-f9496274f3ad None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.388551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.400913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 256/497] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:48.401901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926b93b-b173-4da6-b1a2-d7355b8b6a43 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.402191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926b93b-b173-4da6-b1a2-d7355b8b6a43 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.402464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926b93b-b173-4da6-b1a2-d7355b8b6a43 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.403671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 257/498] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:48.404343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926b93b-b173-4da6-b1a2-d7355b8b6a43 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.418069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84698f-86a9-41cc-b3c3-c9032ea7d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.418816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84698f-86a9-41cc-b3c3-c9032ea7d98d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.419127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84698f-86a9-41cc-b3c3-c9032ea7d98d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.419403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84698f-86a9-41cc-b3c3-c9032ea7d98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.461965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.489633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84698f-86a9-41cc-b3c3-c9032ea7d98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:48.491122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84698f-86a9-41cc-b3c3-c9032ea7d98d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:48.510227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926b93b-b173-4da6-b1a2-d7355b8b6a43 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.543954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.544571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.544845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.545131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.556321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:48.557742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:48.571979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:48.572906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:48.573754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:48.573754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:48.573754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:48.573754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 258/499] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:48.573966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.606801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 242/500] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:48.608649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db597d5-583a-4bcf-af54-938261969501 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.609142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db597d5-583a-4bcf-af54-938261969501 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.609557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db597d5-583a-4bcf-af54-938261969501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.629067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1db597d5-583a-4bcf-af54-938261969501 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:48.630262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1db597d5-583a-4bcf-af54-938261969501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:48.644077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.682184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5a21a-6d9d-4f8d-b2f5-2bd9d3a39567 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.691468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.704335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 243/501] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:48.705176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db597d5-583a-4bcf-af54-938261969501 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.723888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.724494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.724936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.725208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.726184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:48.726491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:48.727919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:48.738433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 259/502] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:48.739262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.817202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db597d5-583a-4bcf-af54-938261969501 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.844515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8932-079b-434f-8ed4-e0f5addf4ac7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:48.854150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.855037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.855469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.855875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.856644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:48.857153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:48.859687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:48.871609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 244/503] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:48.872536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.884936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.885180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:48.885750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:48.886039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:48.886347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:48.897910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:48.899552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:48.914670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:48.915727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:48.916750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:48.916750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:48.916750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:48.918260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 260/504] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:48.919221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:48.943623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:48.985918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0cfb-7ece-4ba9-b6da-29cdf2ece265 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.020264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.020880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.021158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.021422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.024583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b56cd-ffc4-4382-b93c-70cd7889082e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.032087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:49.037406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:49.038419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:49.039182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 245/505] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:49.040206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.062067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.062715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.062997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.063273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.073490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.074982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:49.089273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:49.090343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:49.091190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:49.091190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:49.091190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:49.094231 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 261/506] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:49.095216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.111585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.145922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e8d7-6218-4010-ab67-a7871660aadb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.165767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.179838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.180464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.180740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.181004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.188912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.190375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.195613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cc28d-6304-431c-94a8-f944bf19ef89 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:49.202826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:49.203729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:49.204611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 246/507] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:49.205172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.234776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.235380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.235661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.235934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.236572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:49.236876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.238265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.250127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 262/508] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:49.250925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.308634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b28b7-1bde-407e-a0f3-a75eb1037186 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.333912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.343044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.343667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.343947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.344218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.348351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b74a-ee93-4d81-9edc-76af64495278 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.354930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.356381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:49.370750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:49.371621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:49.372858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:49.372858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:49.372858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:49.372858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 247/509] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:49.377189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.378065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.384421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.385019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.385292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.385558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.386253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:49.386550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.387962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.396769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 263/510] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:49.397544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.478793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a685ad0e-71a4-4a1a-bbb5-6c1d7ab5ac4d None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.496782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea40952-2aad-4e08-bca7-1c4f60efd408 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.511410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.512026 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.512288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.512556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.513186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:49.513487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.515663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.526989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 248/511] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:49.530729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.531357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.531463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.531639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.531911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.532734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:49.533069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.534528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.556361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 264/512] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:49.556361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.571839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.606624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.633583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134ae46-6a86-4c70-9736-b88e4e4c92ff None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.652805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94371451-23a4-49bb-820d-4d147e004214 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.666737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.667354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.667629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.667898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.674514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.675934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.687323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:49.687503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:49.688274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:49.689133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:49.690187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.690187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.690187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.690399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 249/513] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:49.690468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:49.690532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.690596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.690758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.704171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 265/514] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:49.705003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.788579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.792404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24fdb-b707-4753-94be-3df2eb21562e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.803275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ed4fd-197d-470e-a496-3a199e9b3b2c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.816698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:49.827287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.828049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.828333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.828598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.839005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.839253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.839876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.840152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.840419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.840505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.849042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:49.850513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:49.854468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:49.855518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:49.856352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:49.856352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:49.856352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:49.856352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 250/515] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:49.856352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:49.865633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:49.866698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 266/516] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:49.867572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:49.959900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c2805-c71a-4348-9c39-47ed5813854b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.966009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8ba0-8720-4faf-945f-b6cead85cb7d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:49.992781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.993368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.993641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:49.993904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:49.998981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:49.999652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:49.999937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.000209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.000901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:50.001206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.002673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.015667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.020792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 267/517] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:50.021583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.053723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.064159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.065632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.122064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac98924-7fa6-49ff-bfa1-3f50396144a8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.156827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.157426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.157704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.157972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.158640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.160067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.162644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 251/518] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:50.163471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.181198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 268/519] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:44:50 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:44:50.182008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.224664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.280460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8219ca6-10fe-4d7c-8df9-828cedfc40df None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.301001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.316547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f668-baf9-4e92-8a07-b5340080849a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.321665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c35563-b089-4647-899a-f75203851b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.322537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c35563-b089-4647-899a-f75203851b93 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.322960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c35563-b089-4647-899a-f75203851b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.323371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c35563-b089-4647-899a-f75203851b93 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.324195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c35563-b089-4647-899a-f75203851b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:50.324499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c35563-b089-4647-899a-f75203851b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.325959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c35563-b089-4647-899a-f75203851b93 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.340913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 252/520] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:50.340913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c35563-b089-4647-899a-f75203851b93 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.359923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.360573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.360817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.361088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.361825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:50.362190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.363638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.383485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 269/521] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:50.384327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.452070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c35563-b089-4647-899a-f75203851b93 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.466384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.491558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.492071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.492352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.492625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.493358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=8908c33eb701459298d35fa8ccb80bd2) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:50.493667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.495128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.510121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 253/522] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/role_assignments?user.id=8908c33eb701459298d35fa8ccb80bd2&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:50.510121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.510419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f4bd7-89cc-49c9-a5cd-8e85f4b2788f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.556651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.557301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.557579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.557851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.569655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.571243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.579904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:50.590666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:50.591833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:50.593545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:50.593545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:50.593545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:50.593545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 270/523] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:50.593782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.632739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1110e92-4925-4b44-9ec1-7a2f0f5916ac None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.672202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.672834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.673113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.673385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.684424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.686638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:50.699019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:50.699957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 14:44:50.700843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:50.705539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 254/524] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:50.706454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:50.726520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd8aa-c611-40d0-944e-e6fc2c48aa8b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.752810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.772850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.773457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.773730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.773996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.837978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4b09-8360-4f45-b461-0540b62e70b7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:50.867401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:50.874456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:50.874830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.875190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:50.875465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:50.875728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:50.876359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:50.876657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:50.877572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.877999 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:50.899235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 255/525] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:50.900140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.009986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:51.016607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 271/526] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:51.016607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.021941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade415b-7d57-4e3d-ac7f-c613ed60a380 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:51.072115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:51.073594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:51.074365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:51.074842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:51.076095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:51.077367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:51.079410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:51.128087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 256/527] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Sep 9 14:44:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:51.129145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.130260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:51.136960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd90da-d36f-4bb7-a3d5-168bdd4a5469 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:51.186892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:51.188398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:51.189139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:51.189614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:51.199681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:51.202398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:51.222243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:51.223222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:51.224042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:51.226660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 272/528] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:51.227896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.251811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026494c-ec6e-452a-a4e1-80ff83b9292f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:51.292150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:51.292924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:51.293033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:51.293290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:51.304445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:51.305885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:51.322020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:51.322986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:51.323813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:51.323813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:51.323813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:51.327794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 257/529] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:51.328650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.340058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:51.366441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ee1f-00f1-414b-af6a-3c8c058b6a4f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:51.405386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:51.406321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:51.406694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:51.407054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:51.438009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:51.468406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bd63f-623c-4788-b519-08ba149ba54a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:51.489468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:51.491001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:51.524024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:51.525050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:51.525509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:51.525957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:51.527099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:51.528416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:51.530303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:51.555416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 258/530] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:51.557193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.606617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 273/531] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:51.607644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.636114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:51.677783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d3921-b06c-4e39-b7b6-90586956e3ca None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:51.695805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:51.730959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:51.731901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:51.732397 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:51.732891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:51.734864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:51.735666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:51.738278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:51.746416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e397bd-6e25-40be-943c-91f3d8b06362 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:51.754516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 259/532] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:51.760324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.788633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:51.789267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:51.789644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:51.790027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:51.790940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=3849cb5e321d48c88f0e19121ec7e1a5) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:51.791327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:51.792896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:51.809245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 274/533] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/role_assignments?user.id=3849cb5e321d48c88f0e19121ec7e1a5&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:51.809245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:51.963256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f02a6-8143-44bd-9e38-bc977dfd10b7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:52.004936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a53a8-962d-473c-90c1-35a9ed81910c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:52.017225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:52.028896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:52.030797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.031481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.032182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.041514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:52.049020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:52.050607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:52.056913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:52.057799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.058290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.058765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.066026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:52.067137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:52.068015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:52.069970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:52.069970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:52.069970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:52.069970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 260/534] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:52.071198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:52.073610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:52.086426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:52.087292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:52.088121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:52.090197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 275/535] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:52.097780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:52.254624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c762229b-89f8-429e-af1b-3e7a86ef1c5e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:52.273864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76623e-21cc-46a8-ad6b-60031133b460 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:52.296955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:52.298457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.299082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.299656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.300802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:52.301307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:52.302960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:52.317625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 276/536] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:52.324864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:52.345780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:52.346415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.346689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.346957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.347596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:52.347893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:52.349268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:52.373755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 261/537] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:52.379294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:52.410480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:52.462465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:52.523579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb33fb-fc6f-4fa6-9e84-5440f3db7cd1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:52.526909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd18f2-6c0b-4e71-bff6-17eb184c7978 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:52.563422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b84e6-7ff5-4a2b-8139-fd9ecfe626d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:52.563655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:52.564239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.564517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.564802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.565227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b84e6-7ff5-4a2b-8139-fd9ecfe626d8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.565643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b84e6-7ff5-4a2b-8139-fd9ecfe626d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.566063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b84e6-7ff5-4a2b-8139-fd9ecfe626d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.567072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b84e6-7ff5-4a2b-8139-fd9ecfe626d8 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=23f4b0027d97468c9b6f73381eb76a3f) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:52.567516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b84e6-7ff5-4a2b-8139-fd9ecfe626d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:52.569192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b84e6-7ff5-4a2b-8139-fd9ecfe626d8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:52.572202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:52.573729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:52.576050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 277/538] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:52 2022] GET /identity/v3/role_assignments?user.id=23f4b0027d97468c9b6f73381eb76a3f&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:52.577636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec07b4-c376-4525-8023-6b774959faa7 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.578072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec07b4-c376-4525-8023-6b774959faa7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.578503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec07b4-c376-4525-8023-6b774959faa7 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.579975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 278/539] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:52.587807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:52.588944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:52.589940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 262/540] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:52.596896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:52.597092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003050de-e693-4b8b-8a46-739e04834058 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.597092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003050de-e693-4b8b-8a46-739e04834058 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.597092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003050de-e693-4b8b-8a46-739e04834058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.632706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-003050de-e693-4b8b-8a46-739e04834058 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:52.635417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-003050de-e693-4b8b-8a46-739e04834058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:52.772777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:52.777979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18674511-aa8c-4cfb-8b58-252c45ce8baf None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:52.817408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93e8ea-4c70-4c34-bfdc-652f4f0fdc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:52.818351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e8ea-4c70-4c34-bfdc-652f4f0fdc85 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.818768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e8ea-4c70-4c34-bfdc-652f4f0fdc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.819229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93e8ea-4c70-4c34-bfdc-652f4f0fdc85 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.820056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e8ea-4c70-4c34-bfdc-652f4f0fdc85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:52.820510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e8ea-4c70-4c34-bfdc-652f4f0fdc85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:52.822160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93e8ea-4c70-4c34-bfdc-652f4f0fdc85 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:52.829382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 279/541] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:52.837621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 263/542] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:52.843867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003050de-e693-4b8b-8a46-739e04834058 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:52.845806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefd0b4-38d6-49d1-be9b-1fd1cd6b0441 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.846130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefd0b4-38d6-49d1-be9b-1fd1cd6b0441 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.846404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefd0b4-38d6-49d1-be9b-1fd1cd6b0441 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.848804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 264/543] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:44:52.852975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54197-3877-4276-b723-be67672a7d0c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:52.853258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54197-3877-4276-b723-be67672a7d0c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:52.853529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54197-3877-4276-b723-be67672a7d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:52.877967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-21e54197-3877-4276-b723-be67672a7d0c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:52.879206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-21e54197-3877-4276-b723-be67672a7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:52.908416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:52.982702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003050de-e693-4b8b-8a46-739e04834058 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:53.038542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 265/544] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:44:53.055586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:53.056203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:53.056480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:53.056748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:53.057485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=b7a92823ec184a86a8ce70ffa1a4424b) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:53.057792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:53.059281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:53.070153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 280/545] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:52 2022] GET /identity/v3/role_assignments?user.id=b7a92823ec184a86a8ce70ffa1a4424b&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:53.262391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54197-3877-4276-b723-be67672a7d0c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:53.344219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:53.385395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:53.408903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54197-3877-4276-b723-be67672a7d0c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:53.469714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:53.471980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:53.472476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:53.472940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:53.496156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:53.503276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:53.504146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:53.504922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:53.511129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 266/546] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:53.516623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:53.532605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:53.537729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959a17c-f11c-4439-b0e6-1d4338a91bc9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:53.602050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:53.603079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:53.603574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:53.605501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:53.625608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:53.635879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:53.636756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:53.637512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:53.645373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 281/547] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:53.652218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:53.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4c1c-1e36-45c9-87ca-30336217af9e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:53.754509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:53.755111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:53.755384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:53.755653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:53.756338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:53.758130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:53.758325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:53.768004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 267/548] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:53.773319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:53.802457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:53.859553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5109077-dd3e-4839-9564-6d2813c16035 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:53.911239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:53.911858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:53.912136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:53.912406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:53.913069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:53.913370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:53.914770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:53.929858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801c93-2a89-4747-96f0-e851c6688b93 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:53.932156 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 282/549] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:53.936573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:53.970246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:53.970885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:53.971216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:53.971407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:53.983314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:53.984782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:53.989216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:53.999990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:54.001097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:54.001927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:54.001927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:54.001927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:54.001927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 268/550] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:54.006879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.070476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:54.115062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bef2a-c261-4afc-bf17-c0a68eb3138e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:54.135789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94e3b0-65eb-4c30-b4b4-1de932c78157 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:54.168786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:54.169400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.169682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.169958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.170884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:54.171354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:54.172754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:54.185025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 269/551] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:54.190506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.211709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:54.212349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.212624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.212896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.233638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:54.235320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:54.253765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:54.256063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:54.259140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:54.259140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:54.259140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:54.259140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 283/552] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:54.266598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.313805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb0483-7ef0-4fa8-a459-38db6ab828a1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:54.349337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:54.349976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.350363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.350641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.358998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:54.360485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:54.382743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:54.389379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:54.391780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:54.393989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 270/553] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:54.402186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.406652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:54.435468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c405d4-88c3-46f5-b4eb-b293e7ed7cd6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:54.486820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1705d8-98f0-490e-9721-a3acf66bcc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:54.487539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1705d8-98f0-490e-9721-a3acf66bcc44 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.487821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1705d8-98f0-490e-9721-a3acf66bcc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.488091 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1705d8-98f0-490e-9721-a3acf66bcc44 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.488735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1705d8-98f0-490e-9721-a3acf66bcc44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:54.489038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1705d8-98f0-490e-9721-a3acf66bcc44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:54.490569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1705d8-98f0-490e-9721-a3acf66bcc44 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:54.504863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 284/554] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:54.506744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393251c-1b03-4c70-b968-7d61ce906cef None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.507026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393251c-1b03-4c70-b968-7d61ce906cef None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.507296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393251c-1b03-4c70-b968-7d61ce906cef None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.508817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 285/555] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:54.510320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393251c-1b03-4c70-b968-7d61ce906cef None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.522389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141ea6c-33cb-4cd8-915b-5e7f47c6130a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:54.571055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fa516-05e8-4501-ac29-a23525d2639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:54.572049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa516-05e8-4501-ac29-a23525d2639e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.572461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa516-05e8-4501-ac29-a23525d2639e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.572869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa516-05e8-4501-ac29-a23525d2639e None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.573655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa516-05e8-4501-ac29-a23525d2639e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:54.573957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa516-05e8-4501-ac29-a23525d2639e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:54.576132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa516-05e8-4501-ac29-a23525d2639e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:54.598538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 271/556] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:44:54.599920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aa29d-428a-4bdb-9448-04bd8655b5c7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.600321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aa29d-428a-4bdb-9448-04bd8655b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.600654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aa29d-428a-4bdb-9448-04bd8655b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.624564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2e7aa29d-428a-4bdb-9448-04bd8655b5c7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:54.625855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2e7aa29d-428a-4bdb-9448-04bd8655b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:54.643012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393251c-1b03-4c70-b968-7d61ce906cef None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:54.668389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:54.689134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:54.690196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.690542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.691012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.693630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:54.700155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:54.702456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:54.719507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:54.721108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:54.722248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 286/557] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:54.722845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.723951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 272/558] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:54.727190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aa29d-428a-4bdb-9448-04bd8655b5c7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.902204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aa29d-428a-4bdb-9448-04bd8655b5c7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:54.943272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:54.944120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:54.944411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:54.944693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:54.945444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:54.945749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:54.947697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:54.969669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 273/559] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:54.975589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:54.980095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d074bd-1237-4c25-9789-e68484bac0e4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.007744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.029513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9978-3bf5-4f92-84f8-9e351fbf69cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.030293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9978-3bf5-4f92-84f8-9e351fbf69cc None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.030573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9978-3bf5-4f92-84f8-9e351fbf69cc None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.030867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9978-3bf5-4f92-84f8-9e351fbf69cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.093798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7f24b-619c-462d-95a2-fccf596e90ad None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.097503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.106145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9978-3bf5-4f92-84f8-9e351fbf69cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.107878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9978-3bf5-4f92-84f8-9e351fbf69cc None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.133324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.134533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.135387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.135863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.150687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.152132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:55.167180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:55.168143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:55.169002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:55.169002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:55.169002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:55.169002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 274/560] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:55.169002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.224703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 287/561] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:44:55.225952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae9295-5805-4de1-a7db-2de01dc7a557 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.226268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae9295-5805-4de1-a7db-2de01dc7a557 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.226541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae9295-5805-4de1-a7db-2de01dc7a557 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.227991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 288/562] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:55.228473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae9295-5805-4de1-a7db-2de01dc7a557 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.286748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e65f20-0199-4701-9ed9-aa24b4207cac None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.330123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39967816-277b-4191-889c-47059b585dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.330643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.332289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39967816-277b-4191-889c-47059b585dac None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.332617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39967816-277b-4191-889c-47059b585dac None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.333232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39967816-277b-4191-889c-47059b585dac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.340301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae9295-5805-4de1-a7db-2de01dc7a557 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.345388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39967816-277b-4191-889c-47059b585dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-39967816-277b-4191-889c-47059b585dac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:55.351503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:55.352626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:55.353629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 275/563] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:55.354358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39967816-277b-4191-889c-47059b585dac None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.380659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cac2d-2647-4cef-bc14-58743d28068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.381474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cac2d-2647-4cef-bc14-58743d28068d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.381588 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cac2d-2647-4cef-bc14-58743d28068d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.381801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cac2d-2647-4cef-bc14-58743d28068d None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.382480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cac2d-2647-4cef-bc14-58743d28068d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:55.382784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cac2d-2647-4cef-bc14-58743d28068d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.384338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cac2d-2647-4cef-bc14-58743d28068d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.400682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 289/564] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:55.400682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958556a-63d6-4b19-801f-7da8ad0a282b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.400682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958556a-63d6-4b19-801f-7da8ad0a282b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.400682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958556a-63d6-4b19-801f-7da8ad0a282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.417367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b958556a-63d6-4b19-801f-7da8ad0a282b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:55.418539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b958556a-63d6-4b19-801f-7da8ad0a282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:55.466271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39967816-277b-4191-889c-47059b585dac None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.499703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 290/565] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:55.500770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958556a-63d6-4b19-801f-7da8ad0a282b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.511627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.512427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.512851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.513306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.525770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.529161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.531139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:55.547905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:55.549051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:55.550170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:55.550170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:55.550170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:55.555302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 276/566] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:55.556209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.609124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.629156 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958556a-63d6-4b19-801f-7da8ad0a282b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.668661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.670040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.671313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.671964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.672899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:55.673360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.674693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd789a-b115-4c55-8e84-f9bb300bb08b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.675057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.684794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 291/567] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:55.688780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.712574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.713206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.713486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.713807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.721847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.723349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:55.736877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:55.738512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:55.739626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:55.742903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 277/568] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:55.743742 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.801258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.806125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519a34b-c817-478a-8e99-3e8f4c61c883 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.839541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.840124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.840403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.840667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.841297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:55.841593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.843711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.849103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea416c-f079-46cf-b6fd-7e80ddfb5ade None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.855029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 292/569] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:55.855799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.864567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:55.888092 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d4ea3-4041-4e91-9d9e-35aefbf1c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.888712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4ea3-4041-4e91-9d9e-35aefbf1c665 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.889027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4ea3-4041-4e91-9d9e-35aefbf1c665 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.889298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4ea3-4041-4e91-9d9e-35aefbf1c665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.899712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d4ea3-4041-4e91-9d9e-35aefbf1c665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.901153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d4ea3-4041-4e91-9d9e-35aefbf1c665 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-3a3d4ea3-4041-4e91-9d9e-35aefbf1c665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:55.915836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:55.916765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:55.917631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:55.917631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:55.917631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:55.917631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 278/570] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:55.918256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973856c2-0c75-4585-9def-e40690f62282 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.918410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973856c2-0c75-4585-9def-e40690f62282 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.918718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973856c2-0c75-4585-9def-e40690f62282 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.919882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 279/571] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:55.924506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973856c2-0c75-4585-9def-e40690f62282 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:55.961023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08f06b-853e-4926-a6e1-29bb43510eff None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:55.995452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:55.996059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:55.996342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:55.996617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:55.997299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:55.997605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:55.999318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.010580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 293/572] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:56.011399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.021764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973856c2-0c75-4585-9def-e40690f62282 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.025054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.058709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.059329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.059607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.059880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.070328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:56.075105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:56.076187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:56.077075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 280/573] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:56.077751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.078423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.114216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6c9cf-8b51-45f9-b4ca-feca881f3581 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.147240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b83e1-c40a-4f7f-a773-70c62883395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.147868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b83e1-c40a-4f7f-a773-70c62883395b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.148148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b83e1-c40a-4f7f-a773-70c62883395b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.148420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b83e1-c40a-4f7f-a773-70c62883395b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.155103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b83e1-c40a-4f7f-a773-70c62883395b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.156471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b83e1-c40a-4f7f-a773-70c62883395b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8a8b83e1-c40a-4f7f-a773-70c62883395b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:56.167434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:56.168419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:56.169361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 294/574] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:56.169850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f780661-8f86-4db4-bd46-072fe3bd6d8b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.169850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f780661-8f86-4db4-bd46-072fe3bd6d8b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.170779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f780661-8f86-4db4-bd46-072fe3bd6d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.180457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d8a0-5a6d-40af-8bc3-857c560c3b7a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.189252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5f780661-8f86-4db4-bd46-072fe3bd6d8b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:56.190467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5f780661-8f86-4db4-bd46-072fe3bd6d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:56.216585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.217190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.217468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.217747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.218409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:56.218711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.220118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.231602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 281/575] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:56.232365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.256735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 295/576] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:56.257565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f780661-8f86-4db4-bd46-072fe3bd6d8b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.258933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.312416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.343901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce2e73-7dca-4f64-8a1b-a1f08354c54f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.356139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f780661-8f86-4db4-bd46-072fe3bd6d8b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.382990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.383645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.383923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.384195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/8908c33eb701459298d35fa8ccb80bd2/roles/6829f18de75049389086cb4eccc75948` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.391350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.391955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.392236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.392512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.393242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:56.393549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.394959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.399528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=8908c33eb701459298d35fa8ccb80bd2, role_id=6829f18de75049389086cb4eccc75948)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.401088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.407347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 296/577] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:56.407347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.428352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 282/578] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:56 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/8908c33eb701459298d35fa8ccb80bd2/roles/6829f18de75049389086cb4eccc75948 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:56.429404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.533868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.555779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178bb44-172f-45b4-ad8d-2f688af7f712 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.566566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25ede-0554-495e-9fe1-ddf8f9266cd9 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.574510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.593559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.594791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.594791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.594791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.595427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:56.595733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.597158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.611729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 297/579] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:56.612618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.618004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.618781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.619021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.619290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.628141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.629576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:56.641828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:56.642820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:56.643743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 283/580] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:56.644315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.723924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa07c8-5559-428d-b3a8-f3927944d48d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.753126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74509f-85a6-4727-a1f8-f7bae4ec3798 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.759990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.761036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.761316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.761586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.773113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.774590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.788920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8497596-7188-413c-bcec-329bce49631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.789549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8497596-7188-413c-bcec-329bce49631e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.789825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8497596-7188-413c-bcec-329bce49631e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:56.789922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:56.791056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:56.791953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:56.791953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:56.791953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:56.792128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8497596-7188-413c-bcec-329bce49631e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.792196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 298/581] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:56.792196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.794499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.805123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8497596-7188-413c-bcec-329bce49631e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e8497596-7188-413c-bcec-329bce49631e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:56.811343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:56.812336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:56.813199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 284/582] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:56.813913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8497596-7188-413c-bcec-329bce49631e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.832215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:56.902456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff04a68-ea4f-4dd6-8d43-d208d87ed9de None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.925630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8497596-7188-413c-bcec-329bce49631e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:56.941470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.942504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.943011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.943548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.944457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=c7d4404bc9fb4bae8e8114daecd6409a) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:56.944946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.946701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.953342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 299/583] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/role_assignments?user.id=c7d4404bc9fb4bae8e8114daecd6409a&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:56.954522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:56.969771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:56.970747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:56.971370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:56.971802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:56.972565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:56.972874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:56.974402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:56.997159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 285/584] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:56.998974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.072315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.097779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.106015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ed86-15ba-4ede-9713-eeb13b4b9fe2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.144993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.145670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299ab91-d9bc-4771-8e34-e21e493c18f4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.146486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.147005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.147505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.148363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:57.148870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.150490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.168773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 300/585] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:57.169192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.204113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.204636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.205195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.205466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.207421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:57.207728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.209111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.220347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 286/586] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:57.221079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.279847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ea921-f114-42ea-87ea-9e264ffce2bb None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.322196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.323320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.323598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.323867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.339528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238becc-9dc5-4b6f-b670-4ccb619c2836 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.339885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.341646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.356337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:57.362082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:57.363048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:57.363928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:57.363928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:57.363928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:57.366476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 301/587] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:57.367072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.381539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.383440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.384076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.384350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.384620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.394958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.396376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:57.408659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:57.409737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:44:57.410780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:57.414322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 287/588] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:57.415147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.509410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2b210-7cde-4277-97b6-88fb7af6bfaa None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.522776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c9770-1da4-42e6-a81e-60e4f9c3da53 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.554704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.555775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.556310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.556720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.558025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.558713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.559014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.559267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.559900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:57.560197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.561790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.570118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.572590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.578064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 288/589] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:57.578064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:57.596842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:57.597957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:57.598837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:57.598837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:57.598837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:57.600945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 302/590] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:57.602058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.642483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.678240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.689503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0b096-0de3-4015-b276-73dfb2016663 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.731872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.733237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.733654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.734015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.735050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:57.735508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.737175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.739077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9eb55-5f08-4c3d-973c-0fd8059c09b2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.761849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 289/591] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:57.762888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.775343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.776187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.776707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.777115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.785120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.786767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:57.799112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:57.800134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:57.801141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:57.806157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 303/592] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:57.807221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.864100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.873020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e418c-7e99-4248-91d8-877bc84029f5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.911170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.911816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.912093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.912390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:57.913026 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:57.913392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:57.914822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:57.928853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 290/593] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:57.929713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:57.937674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dcb26-60dc-432d-9c28-638346fca524 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:57.962390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:57.995016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:57.996697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:57.997477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:57.997925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.012641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.015533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:58.035916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:58.036859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:58.037702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:58.037702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:58.037702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:58.040215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 304/594] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:58.041129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.046765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff191441-108f-4be6-b003-7a24d1fcc191 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.083789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.084530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.084988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.085367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.086249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:58.086685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.088519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.105611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 291/595] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:58.105611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.121697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:58.181951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8910b3d-48fb-4a49-9647-8ee2b4e0540e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.221448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb888-7ef9-4218-b1ef-38d8cc1f0260 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.224302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.225392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.225392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.225745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.236222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.237855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:44:58.250328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:58.251317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:58.252225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 305/596] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:58.253490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.267169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.267835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.268180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.268520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.269236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:58.269604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.271299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.283887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 292/597] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:58.289215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.295077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:58.366292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:58.397325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9075b8b-1abc-437b-975a-e291ed2901aa None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.399763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c94276-e64b-4830-8d30-a36417b6afb5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.438520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.439492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.439998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.440606 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.441657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:58.442069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.442301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.443007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.443379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.443749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/3849cb5e321d48c88f0e19121ec7e1a5/roles/6829f18de75049389086cb4eccc75948` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.444405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.459531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=3849cb5e321d48c88f0e19121ec7e1a5, role_id=6829f18de75049389086cb4eccc75948)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.461164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.466761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 293/598] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Sep 9 14:44:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:58.467764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.478315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 306/599] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:58 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/3849cb5e321d48c88f0e19121ec7e1a5/roles/6829f18de75049389086cb4eccc75948 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:58.479219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.577990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:58.601447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab7774-1245-4ab6-a1aa-2bb262013c68 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.608405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b50ea-7da9-42c5-881c-a0affc4b1bcb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.644183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:58.657179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1347f87-a5c7-4027-8133-951407adbcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.657945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347f87-a5c7-4027-8133-951407adbcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.658818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347f87-a5c7-4027-8133-951407adbcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.659096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1347f87-a5c7-4027-8133-951407adbcc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.664309 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.664960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.665240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.665510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.675101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1347f87-a5c7-4027-8133-951407adbcc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.676593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1347f87-a5c7-4027-8133-951407adbcc0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.688522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.690032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-a1347f87-a5c7-4027-8133-951407adbcc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:58.694494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:58.695466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:58.696367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:58.705151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 294/600] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:58.706735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d339-5ef3-4fa3-bafb-f7ad9001ae3f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.707518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d339-5ef3-4fa3-bafb-f7ad9001ae3f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.707994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9d339-5ef3-4fa3-bafb-f7ad9001ae3f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.713869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 295/601] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:44:58.714291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:58.715199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:44:58.716098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:44:58.716098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:44:58.716098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:58.716098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 307/602] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:58.716716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.719192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b4559-580d-4341-b7c4-0818a801edb4 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.719736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b4559-580d-4341-b7c4-0818a801edb4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.720205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b4559-580d-4341-b7c4-0818a801edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.743964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fb5b4559-580d-4341-b7c4-0818a801edb4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:58.746312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fb5b4559-580d-4341-b7c4-0818a801edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:58.829605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 296/603] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:58.834138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b4559-580d-4341-b7c4-0818a801edb4 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:58.866650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624e5c1-c66e-433c-aff2-4d50233e6319 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:58.917865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:58.926697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:58.927559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:58.928044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:58.928492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:58.930398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:58.930909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:58.933809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:58.959926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 308/604] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:58.962081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.021412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b4559-580d-4341-b7c4-0818a801edb4 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:59.060818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:59.087116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:59.087905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.088183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.088451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.089097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:59.089396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:59.090791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:59.109757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 297/605] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:59.120638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.150007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03a60-9c86-4a76-ac21-0131c9e0608a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:59.213926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:59.214698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.214980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.215254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/23f4b0027d97468c9b6f73381eb76a3f/roles/6829f18de75049389086cb4eccc75948` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.234333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=23f4b0027d97468c9b6f73381eb76a3f, role_id=6829f18de75049389086cb4eccc75948)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:59.236813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:59.265175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 309/606] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:58 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/23f4b0027d97468c9b6f73381eb76a3f/roles/6829f18de75049389086cb4eccc75948 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:44:59.265175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.306930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090969-bdb8-462c-85e4-e375733a05ba None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:59.336976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:59.348611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66730996-e1df-4dd8-8f7d-f6e1430905a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:59.349338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730996-e1df-4dd8-8f7d-f6e1430905a2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.349711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730996-e1df-4dd8-8f7d-f6e1430905a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.350074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66730996-e1df-4dd8-8f7d-f6e1430905a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.358704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66730996-e1df-4dd8-8f7d-f6e1430905a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:59.360415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66730996-e1df-4dd8-8f7d-f6e1430905a2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-66730996-e1df-4dd8-8f7d-f6e1430905a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:44:59.372887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:59.374784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:44:59.375771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 298/607] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:44:59.378122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3318e0-5fbc-4d1f-a577-8eb1b1f14c3f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.378122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3318e0-5fbc-4d1f-a577-8eb1b1f14c3f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.378122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3318e0-5fbc-4d1f-a577-8eb1b1f14c3f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.383472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 299/608] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:44:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:44:59.384498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3318e0-5fbc-4d1f-a577-8eb1b1f14c3f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.432569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb377c46-9f33-42c9-98e4-ba711cd0367c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:59.439057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:59.480242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6056a-035f-43be-a848-6e67a909f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:59.480890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6056a-035f-43be-a848-6e67a909f973 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.481168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6056a-035f-43be-a848-6e67a909f973 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.481441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6056a-035f-43be-a848-6e67a909f973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.493772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6056a-035f-43be-a848-6e67a909f973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-81d6056a-035f-43be-a848-6e67a909f973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:44:59.499566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:44:59.500606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:44:59.501871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 310/609] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:44:59.502698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f22b-2b8a-49ba-90ad-23f64da2c34e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.502698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f22b-2b8a-49ba-90ad-23f64da2c34e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.503113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0f22b-2b8a-49ba-90ad-23f64da2c34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.513953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3318e0-5fbc-4d1f-a577-8eb1b1f14c3f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:59.527750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7ae0f22b-2b8a-49ba-90ad-23f64da2c34e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:44:59.528989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7ae0f22b-2b8a-49ba-90ad-23f64da2c34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:44:59.563639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:59.564629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.564985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.565319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.566132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:59.566475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:59.568118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:59.585478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 300/610] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:59.586426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.603444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 311/611] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:44:59.604585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f22b-2b8a-49ba-90ad-23f64da2c34e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.666447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:59.738045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:44:59.742697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5c597-7b71-4148-b668-deff853699e3 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:59.790738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:59.791687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.792242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.792515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.793330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:44:59.793642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:59.795449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:59.803989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0f22b-2b8a-49ba-90ad-23f64da2c34e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:44:59.804840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 301/612] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:44:59.811858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.874048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:44:59.874716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:44:59.874935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:44:59.875207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/b7a92823ec184a86a8ce70ffa1a4424b/roles/6829f18de75049389086cb4eccc75948` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:44:59.903491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=b7a92823ec184a86a8ce70ffa1a4424b, role_id=6829f18de75049389086cb4eccc75948)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:44:59.905835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:44:59.930125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 312/613] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:44:59 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/b7a92823ec184a86a8ce70ffa1a4424b/roles/6829f18de75049389086cb4eccc75948 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:44:59.930125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:44:59.960592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f511b-ee28-445d-b6a0-7a637783092c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.000279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.000922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.001196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.001467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:00.015608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:00.017096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:00.034901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:00.035936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:00.036827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:00.036827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:00.036827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:00.042133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 302/614] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:00.043412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:00.079788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:00.141274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:00.166665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41eb180-2b22-415b-a823-afa6ac6c3de5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.220673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac57e2d-9299-4018-97b3-3afb2b170934 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.223681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.224326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.224606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.224878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:00.249399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:00.254553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:00.255468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:00.256544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:00.260741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 313/615] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:00.261578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:00.266830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.267458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.267746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.268079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:00.268749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:00.269054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:00.270510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:00.285874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 303/616] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:00.292148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:00.375228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:00.416760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d84f2-539a-452e-979d-66e3ec4bba45 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.432206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b114d0-9c58-49e9-9093-a3fae44b083f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.456747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.457616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.457893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.460796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:00.462487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:00.462805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:00.464186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:00.481454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 314/617] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:00.487530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:00.494127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:00.497698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.498422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.498698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.498966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:00.506517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:00.507951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:00.520433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:00.521385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:00.522984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 304/618] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:45:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:00.527744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:00.639773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561209e-dc6e-4222-bb4a-4da4f4d346cd None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.679196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.679725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.680002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.680268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:00.681150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:00.681459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:00.685195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:00.685195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:00.704128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 305/619] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:45:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:00.710230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:00.745844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ec8e6-1a11-4c5d-8fc7-dd72f1b1802f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.821641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.822342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.822621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.823326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:00.836680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:00.838184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:00.854713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:00.855719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:00.856760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:00.856760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:00.856760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:00.856760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 315/620] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:00.860168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d3291-8bd5-4101-87b5-523a807a63e7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:00.863065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:00.922363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e55b3-cf0b-4b81-87a3-5f0aa8fbbbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:00.922966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e55b3-cf0b-4b81-87a3-5f0aa8fbbbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:00.923236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e55b3-cf0b-4b81-87a3-5f0aa8fbbbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:00.923501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e55b3-cf0b-4b81-87a3-5f0aa8fbbbe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.000504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.008376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.011967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e55b3-cf0b-4b81-87a3-5f0aa8fbbbe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.013443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e55b3-cf0b-4b81-87a3-5f0aa8fbbbe9 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:01.111862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853135d-77bf-4fc0-bd9c-85f96c979f09 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.146529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 306/621] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:45:01.148440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fb6a5-8f1f-406a-b477-d1b641b5a241 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.148726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fb6a5-8f1f-406a-b477-d1b641b5a241 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.149116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fb6a5-8f1f-406a-b477-d1b641b5a241 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.150838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 307/622] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:01.151651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fb6a5-8f1f-406a-b477-d1b641b5a241 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.151831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ac05a-8318-40f4-a02e-c653a84bfee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.152362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac05a-8318-40f4-a02e-c653a84bfee7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.152637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac05a-8318-40f4-a02e-c653a84bfee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.152903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ac05a-8318-40f4-a02e-c653a84bfee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.153543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac05a-8318-40f4-a02e-c653a84bfee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:01.153839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac05a-8318-40f4-a02e-c653a84bfee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.156064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ac05a-8318-40f4-a02e-c653a84bfee7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:01.172132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 316/623] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:01.173371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a20de3-26dd-4900-837b-b668140802c9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.173648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a20de3-26dd-4900-837b-b668140802c9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.173917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a20de3-26dd-4900-837b-b668140802c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.198096 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b3a20de3-26dd-4900-837b-b668140802c9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:01.199886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b3a20de3-26dd-4900-837b-b668140802c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:01.268132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.280372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fb6a5-8f1f-406a-b477-d1b641b5a241 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.288592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 317/624] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:01.289433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a20de3-26dd-4900-837b-b668140802c9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.352471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.354430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.354703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.354973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.356840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.377413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.378890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:01.411303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:01.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:01.415301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:01.415301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:01.415301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:01.415301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 308/625] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:01.419097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.460986 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a20de3-26dd-4900-837b-b668140802c9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.498165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.498810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.499092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.499366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.509302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.511063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:01.526792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:01.527754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:01.528861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 318/626] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:01.533971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0b0a5-626b-4653-a294-261813cf04fc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.536101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.598716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.599324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.599604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.599877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.600521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:01.600823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.602291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:01.615067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 309/627] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:01.625513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.630341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.683880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e34d2-fa25-4a92-adb7-0a3f1b2628a4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.693113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.726162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.727092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.727465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.727833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.728708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:01.729107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.730927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:01.751644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 319/628] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:01.752657 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.754262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029e076-86dd-4b5d-9fe2-494f8bb2c611 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.798656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.799279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.799562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.800303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.813582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:01.819678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:01.821303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 310/629] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:01.822419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.868384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6d5f8-d23a-4ccb-a1f1-7e10effa5e8b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.888260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.908179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc59b76-cc23-435c-9c00-9615a554410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.908809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59b76-cc23-435c-9c00-9615a554410a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.909083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59b76-cc23-435c-9c00-9615a554410a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.909360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59b76-cc23-435c-9c00-9615a554410a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.916823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc59b76-cc23-435c-9c00-9615a554410a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.918308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc59b76-cc23-435c-9c00-9615a554410a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:01.928818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681003b8-91bc-495d-a257-f5d847e22ee8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bbc59b76-cc23-435c-9c00-9615a554410a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:01.929828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:01.930745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:01.931653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 320/630] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:01.932148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d7849-5fa3-4cda-8486-566b8641d48c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.932756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d7849-5fa3-4cda-8486-566b8641d48c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.932756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d7849-5fa3-4cda-8486-566b8641d48c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.937961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 321/631] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:01.937961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d7849-5fa3-4cda-8486-566b8641d48c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:01.960535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:01.974387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:01.975021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:01.975302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:01.975572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:01.988391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:01.989822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:02.004331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:02.005702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:02.006610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:02.006610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:02.006610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:02.006610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 311/632] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:02.006610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.044599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d7849-5fa3-4cda-8486-566b8641d48c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.083334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408beba6-61a6-4a45-9e4d-ebbe4a5eb756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.083862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408beba6-61a6-4a45-9e4d-ebbe4a5eb756 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.084143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408beba6-61a6-4a45-9e4d-ebbe4a5eb756 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.084415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408beba6-61a6-4a45-9e4d-ebbe4a5eb756 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.085600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408beba6-61a6-4a45-9e4d-ebbe4a5eb756 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:02.085911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408beba6-61a6-4a45-9e4d-ebbe4a5eb756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.087778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408beba6-61a6-4a45-9e4d-ebbe4a5eb756 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.102205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 322/633] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:02.102205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324a6d-cdc7-4566-aeb1-c42c44267111 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.102205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324a6d-cdc7-4566-aeb1-c42c44267111 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.102205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31324a6d-cdc7-4566-aeb1-c42c44267111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.112197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7948d-e97b-4f39-acfd-80ebfd95b285 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.120168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-31324a6d-cdc7-4566-aeb1-c42c44267111 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:02.121356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-31324a6d-cdc7-4566-aeb1-c42c44267111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:02.131444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:02.156327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.157101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.157386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.157652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.158352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:02.158892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.161154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.181649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 312/634] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:02.181649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.194827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 323/635] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:02.195839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31324a6d-cdc7-4566-aeb1-c42c44267111 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.221563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:02.301308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046cbbb-6cf1-4dd0-a824-f9877a53a6aa None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.339951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.340795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31324a6d-cdc7-4566-aeb1-c42c44267111 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.341099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.341564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.342001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.343155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:02.344501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.346015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.365616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 313/636] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:02.365616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.386776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790477da-f635-434c-996b-25767adb3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.387493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790477da-f635-434c-996b-25767adb3278 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.387837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790477da-f635-434c-996b-25767adb3278 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.388236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790477da-f635-434c-996b-25767adb3278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.399021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790477da-f635-434c-996b-25767adb3278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.400730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790477da-f635-434c-996b-25767adb3278 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-790477da-f635-434c-996b-25767adb3278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:02.415875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:02.416857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:02.417742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:02.417742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:02.417742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:02.417911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:02.417983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 324/637] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:02.417983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790477da-f635-434c-996b-25767adb3278 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.493289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:02.498825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5170-23fc-4214-8ae7-9e061a615501 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.541088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790477da-f635-434c-996b-25767adb3278 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.556150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4063ec-0b7e-4d17-a6b8-ffdecf92da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.556757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4063ec-0b7e-4d17-a6b8-ffdecf92da5a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.557124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4063ec-0b7e-4d17-a6b8-ffdecf92da5a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.557484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4063ec-0b7e-4d17-a6b8-ffdecf92da5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.558025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4063ec-0b7e-4d17-a6b8-ffdecf92da5a None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=8908c33eb701459298d35fa8ccb80bd2) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:02.558359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4063ec-0b7e-4d17-a6b8-ffdecf92da5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.559980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4063ec-0b7e-4d17-a6b8-ffdecf92da5a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.568379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 314/638] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/role_assignments?user.id=8908c33eb701459298d35fa8ccb80bd2&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:02.569635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1d3e1-1eb6-4c0e-bd61-1f63189a25ee None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.569924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1d3e1-1eb6-4c0e-bd61-1f63189a25ee None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.570448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1d3e1-1eb6-4c0e-bd61-1f63189a25ee None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.574145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 315/639] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:02.574145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1d3e1-1eb6-4c0e-bd61-1f63189a25ee None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.589687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.590440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.590657 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.590928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.598450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.599922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:02.612579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:02.613713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:02.614833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:02.618256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 325/640] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:02.619314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.711030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:02.715725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1d3e1-1eb6-4c0e-bd61-1f63189a25ee None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.736361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8dd00-686c-452d-8f15-6a7685f6fc67 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.752178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a71e4f-728a-418f-8e39-8fde894e0f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.752569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a71e4f-728a-418f-8e39-8fde894e0f85 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.752846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a71e4f-728a-418f-8e39-8fde894e0f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.753112 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a71e4f-728a-418f-8e39-8fde894e0f85 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.753746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a71e4f-728a-418f-8e39-8fde894e0f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:02.754043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a71e4f-728a-418f-8e39-8fde894e0f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.755429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a71e4f-728a-418f-8e39-8fde894e0f85 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.769847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 316/641] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:02.770671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb201-081e-49f5-901a-76d27712f7cf None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.770957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb201-081e-49f5-901a-76d27712f7cf None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.771232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb201-081e-49f5-901a-76d27712f7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.775712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:02.787359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.788232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.788657 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.789070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.789692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-547cb201-081e-49f5-901a-76d27712f7cf None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:02.790934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-547cb201-081e-49f5-901a-76d27712f7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:02.800908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:02.806438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:02.807413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 326/642] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:02.808597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.870039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 317/643] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:02.870974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cb201-081e-49f5-901a-76d27712f7cf None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:02.932975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8e71d-d6c0-49c2-af11-f40b93578df5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.974241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:02.974992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:02.975371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:02.975740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:02.976638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:02.977061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:02.978715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:02.983889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:02.994399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 327/644] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:02.994757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cb201-081e-49f5-901a-76d27712f7cf None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:02.995721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.033982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.034723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.034967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.035333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.042759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.044197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.052670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:03.057688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:03.058682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 318/645] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:03.059842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.114992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb2655-af90-42b9-b7b3-bdd30be5543e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.154131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.155565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.156023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.156461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.157283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:03.157735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.159283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.168955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 328/646] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:03.169813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.179989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ee34b-46fd-48ba-8b9c-d0d7f370ee94 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.216324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.217685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.218038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.218336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/c7d4404bc9fb4bae8e8114daecd6409a/roles/6829f18de75049389086cb4eccc75948` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.234125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=c7d4404bc9fb4bae8e8114daecd6409a, role_id=6829f18de75049389086cb4eccc75948)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.235806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.245017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:03.258638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 319/647] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:45:03 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/c7d4404bc9fb4bae8e8114daecd6409a/roles/6829f18de75049389086cb4eccc75948 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:45:03.259641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.289361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23e3a4-6df6-45ec-96b0-21359024838e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.301489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:03.330921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.332162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.332635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.333084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.334077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:03.334712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.336536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.358923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 329/648] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:03.360242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.407861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f124b-868f-4d26-a705-16d921cbd260 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.458919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.460260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.460604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.461161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.479087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:03.485156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:03.486322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:03.487241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 320/649] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:03.487946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.490722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352f76c-a51a-4e99-bb7e-7956d471a6db None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.535030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.535952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.536233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.536507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.550981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.551844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:03.554009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:03.575101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:03.577909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:03.580087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:03.580087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:03.580087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:03.580087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 330/650] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:03.580087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.599037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04b56a-821f-42dc-a322-d6a4578fd01a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.606171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:03.634978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.635876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.636332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.636801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.710681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a5e34-565c-4f73-aafe-e9d25b46372d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.715379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.717649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.755277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.755888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.756168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.756440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.757099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:03.757404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.758788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.770778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 331/651] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:03.772192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.783092 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:03.838243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 321/652] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:45:03.839416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:03.895492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:03.928466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0028c-592b-412c-9191-8a6a07952aef None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.951700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9dbb-e4ad-49b3-8e33-16511af66fbb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:03.976976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.977764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.978045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.978603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.979672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:03.979982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:03.981894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:03.989597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:03.990471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:03.990818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:03.991157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:03.996326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 332/653] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:03.997172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.007611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.009053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:04.025444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:04.026587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:04.027470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:04.027470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:04.027470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:04.031851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 322/654] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:04.032914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.052286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:04.131517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d819f6-2289-4c13-b48f-768b3fd45606 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.143460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b40f3e-a100-4438-87ab-f314946c93d8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.178836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.179173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.179467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.179748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.179913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.180061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.180213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.180356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.188137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.189558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.191857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.193845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.195770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:04.202477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:04.203639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:45:04.204791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:04.210430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 323/655] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:04.211340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:04.214040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:04.214985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:04.215863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:04.215863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:04.215863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:04.222478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 333/656] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:04.223775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.300817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:04.335149 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cf5b3-a2b5-45bc-8400-66b00971f562 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.378782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd153311-43cc-4328-9d74-6ea5e49a3c3a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.385812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.386925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.387395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.387850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.389440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:04.390143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.392481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.418605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 324/657] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:04.420176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.441969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.443854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.444886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.445597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.447404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:04.448219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.452681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.489480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 334/658] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:04.491210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.579746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:04.595156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12293005-b332-4272-b6ba-e360b6a1834f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.629899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead2c74-415a-4053-988c-0caa431e3b6c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.635422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:04.643706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.644799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.645253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.645981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.647283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:04.647782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.649787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.667151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 325/659] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:04.668248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.672884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.673511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.673883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.674244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.682128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.683859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:04.706656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:04.707883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 14:45:04.708818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:04.712795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 335/660] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:04.713607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:04.805390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d107a-21e0-486d-bec2-1991c2a226c0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.841931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08279-d8a2-4041-9684-5a4b0ca6d575 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:04.843302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.843918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.844193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.844462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.858728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:04.890532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:04.891430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:04.891708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:04.891980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:04.901231 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.903072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.907994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:04.918319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:04.920100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:04.920810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:04.921868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:04.922806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:04.926173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 336/661] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:04.927193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.039825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57625d9-f4e9-4055-8d7e-a5cae04ab7c8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:05.056994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 326/662] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:45:05.056994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.085297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:05.085894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.086198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.086470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.087318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:05.087903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:05.089036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:05.112077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 337/663] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Sep 9 14:45:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:05.112077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.145340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:05.170399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:05.180439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af8e04-b5f3-45da-b309-698d4f0d52a8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:05.222271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1323c8-44ce-4048-8562-b1f2172f915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:05.222877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1323c8-44ce-4048-8562-b1f2172f915a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.223151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1323c8-44ce-4048-8562-b1f2172f915a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.223418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1323c8-44ce-4048-8562-b1f2172f915a None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.224126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1323c8-44ce-4048-8562-b1f2172f915a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:05.224425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1323c8-44ce-4048-8562-b1f2172f915a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:05.225838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1323c8-44ce-4048-8562-b1f2172f915a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:05.227362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972df16d-f041-4502-890d-11c8735b8e47 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:05.243167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 327/664] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:05.243167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40979b6d-d56f-4592-b9fd-9fedd8ec2f9b None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.243167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40979b6d-d56f-4592-b9fd-9fedd8ec2f9b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.243167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40979b6d-d56f-4592-b9fd-9fedd8ec2f9b None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.243167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 328/665] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:05.243167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40979b6d-d56f-4592-b9fd-9fedd8ec2f9b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.271438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:05.272088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.272345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.272619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.283457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:05.284897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:05.301149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:05.302154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:05.303067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:05.303067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:05.303067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:05.303067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 338/666] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:05.303302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.360271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40979b6d-d56f-4592-b9fd-9fedd8ec2f9b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:05.394848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:05.395455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.395731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.395998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.400014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:05.417407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:05.421150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e39b-5a05-4c9f-b3eb-14c1c4753813 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:05.457424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431606a5-ce36-47bc-87e5-a11877288f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:05.458026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431606a5-ce36-47bc-87e5-a11877288f28 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.458375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431606a5-ce36-47bc-87e5-a11877288f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.458661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431606a5-ce36-47bc-87e5-a11877288f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.459313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431606a5-ce36-47bc-87e5-a11877288f28 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=3849cb5e321d48c88f0e19121ec7e1a5) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:05.459686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431606a5-ce36-47bc-87e5-a11877288f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:05.461032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431606a5-ce36-47bc-87e5-a11877288f28 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:05.467116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:05.478463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 339/667] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:05 2022] GET /identity/v3/role_assignments?user.id=3849cb5e321d48c88f0e19121ec7e1a5&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:05.478686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:05.478777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904faab8-7473-4ba8-a0ed-0f1b9e147fed None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.478777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904faab8-7473-4ba8-a0ed-0f1b9e147fed None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.478777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904faab8-7473-4ba8-a0ed-0f1b9e147fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.496194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-904faab8-7473-4ba8-a0ed-0f1b9e147fed None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:05.497420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-904faab8-7473-4ba8-a0ed-0f1b9e147fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:05.582637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 340/668] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:05.583852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904faab8-7473-4ba8-a0ed-0f1b9e147fed None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.610124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 329/669] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:45:05.613296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.726126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:05.782716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:05.812529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904faab8-7473-4ba8-a0ed-0f1b9e147fed None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:05.818025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe24fb-7a3d-4943-b2be-de234bfbddd1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:05.860969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4679100-fb15-472f-8b1e-3ecbaf9d240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:05.861594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4679100-fb15-472f-8b1e-3ecbaf9d240f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.861873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4679100-fb15-472f-8b1e-3ecbaf9d240f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.862163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4679100-fb15-472f-8b1e-3ecbaf9d240f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.865452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa60ec-06a1-4fcf-8b5a-38e2c7a5a98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:05.866597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa60ec-06a1-4fcf-8b5a-38e2c7a5a98f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.867139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa60ec-06a1-4fcf-8b5a-38e2c7a5a98f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.867611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa60ec-06a1-4fcf-8b5a-38e2c7a5a98f None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.868572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa60ec-06a1-4fcf-8b5a-38e2c7a5a98f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:05.869405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa60ec-06a1-4fcf-8b5a-38e2c7a5a98f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:05.871053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa60ec-06a1-4fcf-8b5a-38e2c7a5a98f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:05.875401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4679100-fb15-472f-8b1e-3ecbaf9d240f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:05.876831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4679100-fb15-472f-8b1e-3ecbaf9d240f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:05.887383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 341/670] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:05.889457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31b58c-b84d-4917-ac0f-4fd995924da4 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.889738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31b58c-b84d-4917-ac0f-4fd995924da4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.890010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31b58c-b84d-4917-ac0f-4fd995924da4 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.895642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 342/671] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:05.895642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31b58c-b84d-4917-ac0f-4fd995924da4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e4679100-fb15-472f-8b1e-3ecbaf9d240f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:05.895959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:05.896865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:05.897771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:05.897771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:05.897771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:05.897771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 330/672] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:05.902700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92199dfc-2986-4266-a6af-d1fc8ce81edc None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:05.902987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92199dfc-2986-4266-a6af-d1fc8ce81edc None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:05.903989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92199dfc-2986-4266-a6af-d1fc8ce81edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:05.928235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-92199dfc-2986-4266-a6af-d1fc8ce81edc None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:05.929452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-92199dfc-2986-4266-a6af-d1fc8ce81edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:06.022525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 331/673] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:06.023383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92199dfc-2986-4266-a6af-d1fc8ce81edc None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.073184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31b58c-b84d-4917-ac0f-4fd995924da4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.090202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.129022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.130014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.130543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.131007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.138294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.146115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.150788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:06.163491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:06.164497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:06.165370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:06.172192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 343/674] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:06.173295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.188323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92199dfc-2986-4266-a6af-d1fc8ce81edc None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.235313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.236106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.236685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.236975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.250923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:06.256557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:06.257454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:06.258292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:06.259386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 332/675] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:06.259386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.280701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944d033-83dd-417a-8ab1-033e51daae35 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.322909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.323777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.324063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.324336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.325226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:06.325937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.328208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:06.341264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 344/676] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:06.342850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.368107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.376158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b4d44-a604-4039-9de6-cf6455164336 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.401513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.415271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.415884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.416152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.416423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.417791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:06.417791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.418837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:06.431408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 333/677] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:06.432057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.448325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77af5-2cff-45dc-8034-32cc83dc5631 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.485497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.486278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.486646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.486995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.487739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:06.488110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.489545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:06.503308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 345/678] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:06.503308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.547642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d575438-6be3-414a-b241-3ade9264a394 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.586315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.586942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.587224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.587495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.597847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:06.603539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:06.604497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:06.605332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 334/679] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:06.606017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.615204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781da02-0f6d-4766-9daa-6334977237d8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.622702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.639130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.657864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.658530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.658810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.659079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.665767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.667217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:06.679568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:06.680616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:06.681713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:06.686012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 346/680] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:06.687291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.727516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c757a-69f5-4361-95e2-92abfd7ec8ee None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.763981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.764579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.764857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.765127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.765848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=23f4b0027d97468c9b6f73381eb76a3f) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:06.766184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.767598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:06.778113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 335/681] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/role_assignments?user.id=23f4b0027d97468c9b6f73381eb76a3f&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:06.778113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.796188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ed62-ca54-4b6f-a727-ff54cfb65771 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.838834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.839567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.839910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.840280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.855471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.856778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:06.874687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:06.875791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:06.876694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:06.876694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:06.876694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:06.880815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 347/682] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:06.881843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:06.904695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.918988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:06.940181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bc3b0-7e01-4b22-9aed-9c33ebce2d3c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:06.986753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:06.987658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:06.987946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:06.988221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:06.988889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:06.989193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:06.990871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.000672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 336/683] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:07.002449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.011810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9fb0c-d9e1-4d2e-aaf8-09dc9a50a51a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.055209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.055812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.056088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.056356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.057040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:07.057338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.060863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.072361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 348/684] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:07.073194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.138711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827b978-b26b-446c-b727-0d555e192908 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.176914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.177514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.177788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.178054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.178707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:07.179010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.179184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:07.180728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.191467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:07.192507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67717123-9757-4559-9f23-aab17f47cd34 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.200671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 337/685] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:07.202306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.234373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.235994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.236425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.236901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.251438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.253584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:07.274289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:07.275464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:07.276597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:07.276597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:07.276597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:07.284319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 349/686] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:07.285952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.322539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d727412-2549-4571-b973-d5d49a026005 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.365944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.367106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.367945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.368657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.369641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=b7a92823ec184a86a8ce70ffa1a4424b) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:07.370113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.371849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.381217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 338/687] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/role_assignments?user.id=b7a92823ec184a86a8ce70ffa1a4424b&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:07.383074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.443089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d7861-d1cc-4656-9e28-a9f19f2a9aef None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.507969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:07.511693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29094459-c092-419a-ac54-250aeb499440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.512555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094459-c092-419a-ac54-250aeb499440 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.512995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094459-c092-419a-ac54-250aeb499440 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.513715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29094459-c092-419a-ac54-250aeb499440 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.529304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29094459-c092-419a-ac54-250aeb499440 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.532452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29094459-c092-419a-ac54-250aeb499440 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-29094459-c092-419a-ac54-250aeb499440 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:07.556543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:07.557773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:07.559034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:07.563209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 350/688] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:07.569138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29094459-c092-419a-ac54-250aeb499440 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.578173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8a20-0162-4ecd-b498-1ce41b92859d None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.578696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:07.639006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.639633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.639997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.640274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.640923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:07.641221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.643789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.658158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 339/689] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:07.662404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.739532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29094459-c092-419a-ac54-250aeb499440 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.787728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.788509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.788792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.789067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.790163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:07.790482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.792190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.800395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec873-fdb6-4cd9-ab8d-023973a268ad None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:07.817735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 351/690] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:07.823330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.836686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:07.852521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:07.853588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:07.854130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:07.854611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:07.868173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:07.870019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:07.899296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:07.900308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:07.901343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:07.905676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 340/691] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:07.911754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:07.955544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:08.011037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe487-8759-44b3-a496-3b700b59af4c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:08.029325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d2c55-29d4-44f8-b09c-ae8fd36558f1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:08.051519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed9986-5251-4bf4-87c3-1548c98eceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:08.052485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed9986-5251-4bf4-87c3-1548c98eceac None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.052971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed9986-5251-4bf4-87c3-1548c98eceac None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.053546 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed9986-5251-4bf4-87c3-1548c98eceac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.070738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b0fb6-be02-4942-966f-e34cd275bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:08.071677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b0fb6-be02-4942-966f-e34cd275bad0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.071966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b0fb6-be02-4942-966f-e34cd275bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.072234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b0fb6-be02-4942-966f-e34cd275bad0 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.072955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b0fb6-be02-4942-966f-e34cd275bad0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:08.073247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b0fb6-be02-4942-966f-e34cd275bad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:08.075307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b0fb6-be02-4942-966f-e34cd275bad0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:08.099329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 341/692] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:08.100631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32922e-05da-4619-ac39-0ee8e9d255a0 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.100915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32922e-05da-4619-ac39-0ee8e9d255a0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.101183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32922e-05da-4619-ac39-0ee8e9d255a0 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.102957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 342/693] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:08.108316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32922e-05da-4619-ac39-0ee8e9d255a0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:08.139617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed9986-5251-4bf4-87c3-1548c98eceac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:08.141532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed9986-5251-4bf4-87c3-1548c98eceac None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:08.158886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:08.205212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:08.230693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32922e-05da-4619-ac39-0ee8e9d255a0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:08.251545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 352/694] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 14:45:08.253141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb98d3-9b94-4b7c-bec1-64227c20fb0a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.253572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb98d3-9b94-4b7c-bec1-64227c20fb0a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.254003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb98d3-9b94-4b7c-bec1-64227c20fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.275380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:08.276236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.276663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.277077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.277643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-23cb98d3-9b94-4b7c-bec1-64227c20fb0a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:08.279007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-23cb98d3-9b94-4b7c-bec1-64227c20fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:08.355771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:08.357545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:08.377594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 353/695] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:08.378732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb98d3-9b94-4b7c-bec1-64227c20fb0a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:08.436165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:08.502283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:08.521402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb98d3-9b94-4b7c-bec1-64227c20fb0a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:08.568396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 343/696] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 14:45:08.581088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:08.601565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:08.602288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.602569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.602844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.627396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:08.628866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:08.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:08.660999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:08.661957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:08.661957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:08.661957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:08.663545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 354/697] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:08.666631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:08.759612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af475efa-65ae-4006-bae1-45815cd178f0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:08.795340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31ae13-e58a-44f9-9b2f-db8441a7498b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:08.803910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:08.804536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.804812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.805078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.816993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:08.819525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:08.821394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:08.833940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:08.835024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:08.835510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:08.835988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:08.836833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:08.837365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:08.837608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:08.838530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:08.839429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:08.839429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:08.839429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:08.839429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 344/698] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:08.840105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:08.842248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:08.855388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 355/699] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:08.856500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:08.860438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:08.965482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7fc87-3d1f-4544-a3da-d2dd1c4a7988 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:08.970046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc21c-24fa-4e34-b80a-bfef3c05bda4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.002060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.003051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.003535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.004036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.004879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:09.005382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.007023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.011727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.012355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.012637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.012906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.021836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 356/700] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:09.023059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.027382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.028547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:09.047065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:09.048076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:09.048968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:09.048968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:09.048968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:09.048968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 345/701] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:09.049719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.101755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:09.110427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:09.152729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cd8f4-9d63-47d7-9002-a5d42ab11a39 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.187233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13c1b4-9295-4632-971f-8b3dc5a30b60 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.189332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.189981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.190428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.191296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.197880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.199482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:09.211649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:09.213161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:09.214254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:09.220584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 357/702] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:09.220584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.236182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab48b-968c-464a-a4ee-c01625e13825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.236595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab48b-968c-464a-a4ee-c01625e13825 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.236941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab48b-968c-464a-a4ee-c01625e13825 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.237369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab48b-968c-464a-a4ee-c01625e13825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.243982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab48b-968c-464a-a4ee-c01625e13825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.245532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab48b-968c-464a-a4ee-c01625e13825 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2f4ab48b-968c-464a-a4ee-c01625e13825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:09.259633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:09.260696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:09.261851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:09.262807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 346/703] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:09.263873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172643a0-00e5-4506-9cf8-11be5fa8331c None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.264153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172643a0-00e5-4506-9cf8-11be5fa8331c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.264422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172643a0-00e5-4506-9cf8-11be5fa8331c None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.265751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 347/704] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:09.266373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172643a0-00e5-4506-9cf8-11be5fa8331c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.343377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf664bf-d1f5-4a44-b950-9883b4954136 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.366905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:09.379843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.380508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.380739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.381002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.381601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172643a0-00e5-4506-9cf8-11be5fa8331c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.381708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:09.381933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.383325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.389053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:09.395808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 358/705] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:09.396710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.427822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cddb8-bfdc-4c37-912c-48b97937bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.428426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cddb8-bfdc-4c37-912c-48b97937bc0c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.428699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cddb8-bfdc-4c37-912c-48b97937bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.428958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cddb8-bfdc-4c37-912c-48b97937bc0c None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.429639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cddb8-bfdc-4c37-912c-48b97937bc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:09.429936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cddb8-bfdc-4c37-912c-48b97937bc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.431390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cddb8-bfdc-4c37-912c-48b97937bc0c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.444775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 348/706] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:09.446023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682fc28-e104-438b-84f5-d991861e6cb8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.446336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682fc28-e104-438b-84f5-d991861e6cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.446604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682fc28-e104-438b-84f5-d991861e6cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.464785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9682fc28-e104-438b-84f5-d991861e6cb8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:09.465953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9682fc28-e104-438b-84f5-d991861e6cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:09.508591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f35c3-087e-4c47-bc90-9918ea909801 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.538221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 349/707] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:09.538221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682fc28-e104-438b-84f5-d991861e6cb8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.554212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.555088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.555615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.556116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.557057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:09.557551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.559264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.571301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 359/708] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:09.572391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.630452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:09.669782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:09.676074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622a3ad-bb9b-4151-8e23-ccd358db6f25 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.678382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682fc28-e104-438b-84f5-d991861e6cb8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.713084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.713984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.714566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.715040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.715967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=8908c33eb701459298d35fa8ccb80bd2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:09.716501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.718871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.723204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:09.724080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:09.724358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:09.724627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:09.725277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:09.726806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:09.727032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 360/709] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/role_assignments?user.id=8908c33eb701459298d35fa8ccb80bd2&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:09.728149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.762121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 350/710] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:45:09 2022] POST /identity/v3/users => generated 254 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:09.847864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:09.962163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b35d9-7649-4cbe-8512-8cbf66ffe582 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:09.972802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:09.997217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f527c-183e-40a3-b49e-f53fe99b4e73 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:10.008599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030cf36-2bc3-4a89-a5cb-985fb60c69f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:10.009346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cf36-2bc3-4a89-a5cb-985fb60c69f7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.009727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cf36-2bc3-4a89-a5cb-985fb60c69f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.010119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030cf36-2bc3-4a89-a5cb-985fb60c69f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.011273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030cf36-2bc3-4a89-a5cb-985fb60c69f7 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=c7d4404bc9fb4bae8e8114daecd6409a) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:10.011785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030cf36-2bc3-4a89-a5cb-985fb60c69f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:10.013282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030cf36-2bc3-4a89-a5cb-985fb60c69f7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:10.020504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 361/711] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/role_assignments?user.id=c7d4404bc9fb4bae8e8114daecd6409a&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:10.021765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a141-2f23-4982-9fe1-5d09b44afae4 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.022265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a141-2f23-4982-9fe1-5d09b44afae4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.022596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a141-2f23-4982-9fe1-5d09b44afae4 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.024057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 362/712] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:10.030192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d47653-64c7-427b-8562-58f8539a9807 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.030548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d47653-64c7-427b-8562-58f8539a9807 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.030895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d47653-64c7-427b-8562-58f8539a9807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.041438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:10.042449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.042940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.043398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.044205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:10.046551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:10.056475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b6d47653-64c7-427b-8562-58f8539a9807 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:10.059662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b6d47653-64c7-427b-8562-58f8539a9807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:10.065077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:10.066337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:10.067228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:10.070992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 351/713] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Sep 9 14:45:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:10.076834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:10.101419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:10.170189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 363/714] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 14:45:10.217216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342931d4-08f8-4842-87f0-82137e96bc63 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:10.256651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:10.257357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.257707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.258047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.258776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:10.259152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:10.260585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:10.266539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 352/715] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Sep 9 14:45:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:10.273109 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d47653-64c7-427b-8562-58f8539a9807 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:10.381514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:10.387470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d47653-64c7-427b-8562-58f8539a9807 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:10.428024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:10.428638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.428920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.429194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.429836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:10.430165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:10.431533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:10.438113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 364/716] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Sep 9 14:45:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:10.509877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:10.603678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:10.624589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff78ce-cfc9-4e9d-8e1f-c70f82010493 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:10.665826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:10.666583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.666862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.667131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] PATH_INFO: `/v3/services/network` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.667758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:10.669131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:10.678684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:10.679710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:10.680575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:10.683058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 353/717] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:10 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:10.686870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:10.804983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda46a3a-c0b3-4d3e-9ba0-bb6dad5582c4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:10.845175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6af22-946f-4793-b77e-5ff53806ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:10.845790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6af22-946f-4793-b77e-5ff53806ae9c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:10.846071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6af22-946f-4793-b77e-5ff53806ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:10.846364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6af22-946f-4793-b77e-5ff53806ae9c None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:10.847000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6af22-946f-4793-b77e-5ff53806ae9c None admin] RBAC: Adding query filter params (name=network) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:10.847302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6af22-946f-4793-b77e-5ff53806ae9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:10.848686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6af22-946f-4793-b77e-5ff53806ae9c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:10.853875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 365/718] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:10.860098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:10.992138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e864b60-59d8-4bfb-9e50-f7618f46ba6d None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:11.046833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774ec3e-0f30-4dc7-ac9c-044ad91645ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:11.047467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774ec3e-0f30-4dc7-ac9c-044ad91645ea None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:11.047835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774ec3e-0f30-4dc7-ac9c-044ad91645ea None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:11.048109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774ec3e-0f30-4dc7-ac9c-044ad91645ea None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:11.048750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774ec3e-0f30-4dc7-ac9c-044ad91645ea None admin] RBAC: Adding query filter params (type=network) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:11.049050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774ec3e-0f30-4dc7-ac9c-044ad91645ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:11.050533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774ec3e-0f30-4dc7-ac9c-044ad91645ea None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:11.059447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 354/719] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:12.299051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372dcb6-41a6-443a-8427-09e87979fbb5 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:12.299607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372dcb6-41a6-443a-8427-09e87979fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:12.299607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372dcb6-41a6-443a-8427-09e87979fbb5 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:12.301221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 366/720] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:12.306490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9c8c-812e-4119-8084-680eb91b86b0 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:12.306899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9c8c-812e-4119-8084-680eb91b86b0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:12.307091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9c8c-812e-4119-8084-680eb91b86b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:12.329271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-163e9c8c-812e-4119-8084-680eb91b86b0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:12.330487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-163e9c8c-812e-4119-8084-680eb91b86b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:12.332696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:12.422241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 355/721] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:12.713954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c1b3e-30af-4c37-a366-799494786672 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:12.714270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c1b3e-30af-4c37-a366-799494786672 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:12.714548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c1b3e-30af-4c37-a366-799494786672 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:12.716129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 367/722] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:12.735786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1097-feec-4a7d-8fe1-596432cf6c72 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:12.736059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1097-feec-4a7d-8fe1-596432cf6c72 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:12.736333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1097-feec-4a7d-8fe1-596432cf6c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:12.755608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c1b3e-30af-4c37-a366-799494786672 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:12.761347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-4a4c1097-feec-4a7d-8fe1-596432cf6c72 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:12.761737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4a4c1097-feec-4a7d-8fe1-596432cf6c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:12.813714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:12.890186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 356/723] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:12.926846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c1b3e-30af-4c37-a366-799494786672 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:12.977900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8848b-43f6-4e6a-bcb9-89d316094544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:12.978466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8848b-43f6-4e6a-bcb9-89d316094544 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:12.978745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8848b-43f6-4e6a-bcb9-89d316094544 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:12.979017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8848b-43f6-4e6a-bcb9-89d316094544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:12.989955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8848b-43f6-4e6a-bcb9-89d316094544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-98f8848b-43f6-4e6a-bcb9-89d316094544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:12.994674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:12.995583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:12.996578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 368/724] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:13.002624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1097-feec-4a7d-8fe1-596432cf6c72 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.082453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:13.116335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1097-feec-4a7d-8fe1-596432cf6c72 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.142814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658f00-aa27-421b-ad4c-9077d44a7489 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.143144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658f00-aa27-421b-ad4c-9077d44a7489 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.143370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658f00-aa27-421b-ad4c-9077d44a7489 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.145084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 369/725] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:13.149990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672148-6c3a-4f97-ace5-be6662bb6123 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.150524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672148-6c3a-4f97-ace5-be6662bb6123 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.151013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672148-6c3a-4f97-ace5-be6662bb6123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.153247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.153869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.154378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.154863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.162110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:13.162110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:13.162110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:13.166316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 357/726] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:13.171686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.188409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-76672148-6c3a-4f97-ace5-be6662bb6123 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:13.190240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-76672148-6c3a-4f97-ace5-be6662bb6123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:13.301791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 370/727] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:13.303513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672148-6c3a-4f97-ace5-be6662bb6123 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.334556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:13.352576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b222e-a63e-4355-a201-6217c57de18b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.404518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:13.415791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880596f9-468c-4388-9c4f-d7621b936df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.416426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880596f9-468c-4388-9c4f-d7621b936df7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.416696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880596f9-468c-4388-9c4f-d7621b936df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.416959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880596f9-468c-4388-9c4f-d7621b936df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.438408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880596f9-468c-4388-9c4f-d7621b936df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:13.439862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880596f9-468c-4388-9c4f-d7621b936df7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-880596f9-468c-4388-9c4f-d7621b936df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:13.464193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:13.465218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:13.466172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:13.466172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:13.466172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:13.466172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 358/728] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:13.471364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a51789-2a6c-4222-ae14-78b1ca35fe35 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.471643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a51789-2a6c-4222-ae14-78b1ca35fe35 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.471925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a51789-2a6c-4222-ae14-78b1ca35fe35 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.477308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 359/729] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:13.477308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a51789-2a6c-4222-ae14-78b1ca35fe35 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.480716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672148-6c3a-4f97-ace5-be6662bb6123 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.524537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361da680-8ce0-44d8-abc6-8fb739ebed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.525594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361da680-8ce0-44d8-abc6-8fb739ebed91 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.526194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361da680-8ce0-44d8-abc6-8fb739ebed91 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.526675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361da680-8ce0-44d8-abc6-8fb739ebed91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.538108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361da680-8ce0-44d8-abc6-8fb739ebed91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-361da680-8ce0-44d8-abc6-8fb739ebed91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:13.543564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:13.545032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:13.545885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:13.548739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 371/730] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:13.550803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18bba4-dfb7-442d-8525-1dc87115c98d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.551370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18bba4-dfb7-442d-8525-1dc87115c98d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.551912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18bba4-dfb7-442d-8525-1dc87115c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.570578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7f18bba4-dfb7-442d-8525-1dc87115c98d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:13.573137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7f18bba4-dfb7-442d-8525-1dc87115c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:13.592159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a51789-2a6c-4222-ae14-78b1ca35fe35 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.634143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.635068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.635351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.635624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.636267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:13.636570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:13.637956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:13.651144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 372/731] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:13.651787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18bba4-dfb7-442d-8525-1dc87115c98d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.662626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 360/732] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:13.662626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.665100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:13.712950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:13.764622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18bba4-dfb7-442d-8525-1dc87115c98d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.778312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d401c7-96a2-4c6d-a984-e0aab23a5e08 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.798659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.799484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.799905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.800326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.800988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:13.801285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:13.802730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:13.815875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 373/733] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:13.815875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.820380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53418eb4-2d6d-46d2-89ac-1831510593c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.821099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418eb4-2d6d-46d2-89ac-1831510593c2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.821446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418eb4-2d6d-46d2-89ac-1831510593c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.821793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53418eb4-2d6d-46d2-89ac-1831510593c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.833553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53418eb4-2d6d-46d2-89ac-1831510593c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-53418eb4-2d6d-46d2-89ac-1831510593c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:13.838349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:13.839268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:13.840103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 361/734] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:13.840816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e9b7d-a196-4f88-8a8f-264302cbf36d None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.840893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e9b7d-a196-4f88-8a8f-264302cbf36d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.842261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e9b7d-a196-4f88-8a8f-264302cbf36d None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.846323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 362/735] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:13.846323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e9b7d-a196-4f88-8a8f-264302cbf36d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.895365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:13.927908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406de3b-2429-4e85-bf09-ce12469f0291 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.949863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e9b7d-a196-4f88-8a8f-264302cbf36d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:13.952123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:13.962683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.963307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.963582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.963850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:13.970894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:13.972321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:13.983811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:13.984940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 374/736] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:13.986115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:13.990240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677669b3-ca00-461b-8e03-40616b713d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:13.990867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677669b3-ca00-461b-8e03-40616b713d2d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:13.991141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677669b3-ca00-461b-8e03-40616b713d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:13.991406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677669b3-ca00-461b-8e03-40616b713d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.002191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677669b3-ca00-461b-8e03-40616b713d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.003610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677669b3-ca00-461b-8e03-40616b713d2d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-677669b3-ca00-461b-8e03-40616b713d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:14.018256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:14.019283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:14.020806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:14.020806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:14.020806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:14.020806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 363/737] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:14.020806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf732f-316a-4163-9c68-8fce87a78f40 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.021152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf732f-316a-4163-9c68-8fce87a78f40 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.021243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf732f-316a-4163-9c68-8fce87a78f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.039300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6aaf732f-316a-4163-9c68-8fce87a78f40 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:14.040474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6aaf732f-316a-4163-9c68-8fce87a78f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:14.092967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7ff3-8dba-4dc3-9ad0-bed5d7827175 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.107696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 364/738] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 14:45:14.108501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf732f-316a-4163-9c68-8fce87a78f40 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.129978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:14.137193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.137807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.138120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.138492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.139163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:14.139515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.140887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.149141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 375/739] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:14.149997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.201782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:14.220491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf732f-316a-4163-9c68-8fce87a78f40 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.254719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.255316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.255596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.255868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.256510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.257881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.259932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403fc27-ada3-4ed4-b44c-e67d91160eac None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.278134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 365/740] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:14 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:14.278134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.324802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.327596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.328071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.328493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.329407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:14.329867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.331534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.367439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 376/741] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:14.368630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.422750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a7d81-928b-4914-b0f0-ab486f5db798 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.425375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:14.461626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.462954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.463464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.464205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.464991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:14.465446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.467203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.479797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 366/742] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:14.480617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.488943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:14.494454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fca17-1f6a-4429-8d20-d4a29a3ff432 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.537490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.538201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.538434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.538703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.550249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.551815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:14.569286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:14.570526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:14.571425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:14.571425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:14.571425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:14.571425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 377/743] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:14.571425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.593243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1d24e-0fd9-4283-91d6-28c621404874 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.631900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.632448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.632726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.632993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.643904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.645382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:14.661300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:14.662315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:14.663182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:14.663182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:14.663182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:14.663182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 367/744] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:14.663839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.678244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:14.685520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c359c-b954-4fda-8f39-7078f4dd3607 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.720928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.721542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.721929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.722097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.722794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.724176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.734670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:14.746218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 378/745] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:14 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:14.746218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.795262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb0f22-5ca7-416e-aece-6b60d4480255 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.851107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.851919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.852298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.852667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.862049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.863772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:14.876551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:14.877758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:14.879010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:14.880877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 368/746] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:14.882003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.900525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdd73f-070f-4f53-9317-9c125c57659a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:14.946061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:14.947524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:14.947524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:14.947524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:14.948048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:14.948352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:14.949722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:14.963073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 379/747] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:14.964944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:14.987966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.018508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9160d-b4ba-480c-b35e-3f44a47ca334 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.034017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.059363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.060278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.060652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.061124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.061838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:15.062238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.063703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.077589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 369/748] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:15.083176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:15.105249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d6a06-4624-433b-b03b-9aebcd0a188b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.145128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.145953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.146338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.146682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.147603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:15.148015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.149519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.168941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 380/749] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Sep 9 14:45:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:15.170587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:15.191618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2aad4e-7a6f-4a44-870e-d4203e025010 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.230127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.231127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.231610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.232282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.240036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.241807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:15.254939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:15.256001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:15.256914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:15.259477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 370/750] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:15.260548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:15.265015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.292690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3415e5-23a9-4692-bb9a-a2a606b6de2b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.298155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.336968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.339006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.339523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.340257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.350203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.351966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:15.367893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:15.368801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:15.369678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:15.376778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 381/751] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:15.376778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:15.389188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de333519-86c8-434e-aec6-0fded5ca1e75 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.428609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.429224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.429482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.429669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.506835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256abca4-6fc2-45d6-8207-8a26ffec4228 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.514651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.516110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.554794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.555405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.555685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.555956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.556684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:15.556989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.558437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.561264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.561751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.585228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 382/752] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Sep 9 14:45:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:15.586143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:15.643495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 371/753] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:45:15.644792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:15.691982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d68bc9-ae5e-4eaf-96aa-ddf8775f4d63 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.729217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.729820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.730123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.730400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.731090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:15.731395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.732836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.749232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 383/754] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:15.749232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:15.773959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfc365-80ae-432a-ba7c-dd67ba22c545 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.810630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.816772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.817614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.818055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.818499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.823981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:15.879862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179bb5c-87e9-4532-8c9a-81408d8b99af None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:15.905410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.907788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.918799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:15.919646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:15.920157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:15.920665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:15.932544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:15.934356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:15.952214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:15.953242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:15.954630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:15.954630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:15.954630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:15.956574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 384/755] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:15.957977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.031139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 372/756] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:45:16.032321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.070764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:16.085257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c30a4-78e7-4ab6-badd-7d5ea486ca03 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.094899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:16.126523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:16.127559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.128046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.128552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/8908c33eb701459298d35fa8ccb80bd2/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.130832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=8908c33eb701459298d35fa8ccb80bd2, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:16.132484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:16.154284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 385/757] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:45:15 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/8908c33eb701459298d35fa8ccb80bd2/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:45:16.154284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.180636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1221c3-d6d8-44f9-a781-3a6af320bf0a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.244020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:16.244544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.244824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.245094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.245755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:16.246133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:16.247590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:16.265991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 373/758] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:16.268249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.380142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7c8ae-7ed3-4ae7-9efc-72b5cca6d0b7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.426894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:16.427311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.427590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.427863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.435058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:16.441717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:16.443202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:16.448875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195a492-2aef-4ae2-9788-1ed3b0f1b3a4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:16.460955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:16.461971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:16.462912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:16.462912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:16.462912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:16.466528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 386/759] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:16.467912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.492261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acba873-fecb-4446-a337-4232cc59debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:16.494350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acba873-fecb-4446-a337-4232cc59debf None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.494853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acba873-fecb-4446-a337-4232cc59debf None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.495476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acba873-fecb-4446-a337-4232cc59debf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.496313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:16.507917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acba873-fecb-4446-a337-4232cc59debf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:16.509939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acba873-fecb-4446-a337-4232cc59debf None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-6acba873-fecb-4446-a337-4232cc59debf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:16.524002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:16.524950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:16.525859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 374/760] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:16.527262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af958d3-f9a0-4abd-b580-761ffc6e3f82 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.528001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af958d3-f9a0-4abd-b580-761ffc6e3f82 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.528001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af958d3-f9a0-4abd-b580-761ffc6e3f82 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.530194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 375/761] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:16.532904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af958d3-f9a0-4abd-b580-761ffc6e3f82 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.602488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a3998-67aa-4087-b16c-54486586a92f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.638754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e7f03-74e9-4e22-9b94-817377730b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:16.639486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7f03-74e9-4e22-9b94-817377730b96 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.639839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7f03-74e9-4e22-9b94-817377730b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.640184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e7f03-74e9-4e22-9b94-817377730b96 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.640949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7f03-74e9-4e22-9b94-817377730b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:16.641319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7f03-74e9-4e22-9b94-817377730b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:16.642807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e7f03-74e9-4e22-9b94-817377730b96 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:16.656090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 387/762] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:16.657399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190859-6ba6-4cfd-811b-207fb066c4f2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.657787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190859-6ba6-4cfd-811b-207fb066c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.658198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190859-6ba6-4cfd-811b-207fb066c4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.670635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af958d3-f9a0-4abd-b580-761ffc6e3f82 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.677907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-55190859-6ba6-4cfd-811b-207fb066c4f2 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:16.679257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-55190859-6ba6-4cfd-811b-207fb066c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:16.715135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:16.716210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.716779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.717456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:16.718747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:16.719216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:16.721371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:16.742879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 376/763] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:16.743607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.765500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:16.774171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 388/764] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:16.774171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55190859-6ba6-4cfd-811b-207fb066c4f2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:16.788300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:16.927792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1112d-80cb-435c-ab0c-b9b334a2f679 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.955261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55190859-6ba6-4cfd-811b-207fb066c4f2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:16.993279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:16.993919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:16.994248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:16.994520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.004394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:17.006165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:17.014969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:17.015662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.015884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.016158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.017026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=4dbfce81ff9a43bcbb783a19819ad4a9) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:17.017340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:17.018925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:17.025591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 389/765] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:16 2022] GET /identity/v3/role_assignments?user.id=4dbfce81ff9a43bcbb783a19819ad4a9&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:17.032972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:17.033948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:17.034880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 377/766] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:17.041396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:17.119756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:17.182771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:17.207399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:17.222195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c917-7ab9-4326-a25b-447823184759 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:17.244684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b15a32-2189-49af-8019-e62960addcd8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:17.268060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacdad9-0b1f-4054-8827-2b7c6872da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:17.268716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacdad9-0b1f-4054-8827-2b7c6872da9e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.268996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacdad9-0b1f-4054-8827-2b7c6872da9e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.269398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacdad9-0b1f-4054-8827-2b7c6872da9e None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.270045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacdad9-0b1f-4054-8827-2b7c6872da9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:17.270392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacdad9-0b1f-4054-8827-2b7c6872da9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:17.272202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacdad9-0b1f-4054-8827-2b7c6872da9e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:17.287346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 390/767] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:17.287841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3ea7a-7c8c-4d98-9a68-8f5a2bdccfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:17.288720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955a99-d3d2-4fdb-be86-515c96171aeb None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.288836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ea7a-7c8c-4d98-9a68-8f5a2bdccfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.289005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955a99-d3d2-4fdb-be86-515c96171aeb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.289275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955a99-d3d2-4fdb-be86-515c96171aeb None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.289639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ea7a-7c8c-4d98-9a68-8f5a2bdccfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.290124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3ea7a-7c8c-4d98-9a68-8f5a2bdccfa3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.290913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ea7a-7c8c-4d98-9a68-8f5a2bdccfa3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:17.292518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3ea7a-7c8c-4d98-9a68-8f5a2bdccfa3 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:17.295262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 391/768] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:17.296279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d955a99-d3d2-4fdb-be86-515c96171aeb None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-01a3ea7a-7c8c-4d98-9a68-8f5a2bdccfa3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:17.304964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:17.306028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:17.306910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:17.307639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 378/769] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Sep 9 14:45:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:17.311412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84902e4-6d49-4bf1-9e5f-8d4ad36498d7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.311961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84902e4-6d49-4bf1-9e5f-8d4ad36498d7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.312453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84902e4-6d49-4bf1-9e5f-8d4ad36498d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.336747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d84902e4-6d49-4bf1-9e5f-8d4ad36498d7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:17.339248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d84902e4-6d49-4bf1-9e5f-8d4ad36498d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:17.421970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d955a99-d3d2-4fdb-be86-515c96171aeb None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:17.437424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 379/770] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:17.439347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84902e4-6d49-4bf1-9e5f-8d4ad36498d7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:17.479400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:17.494229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:17.494841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.495114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.495492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.496108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=c7d4404bc9fb4bae8e8114daecd6409a) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:17.496419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:17.498550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:17.512782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 392/771] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:17 2022] GET /identity/v3/role_assignments?user.id=c7d4404bc9fb4bae8e8114daecd6409a&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:17.519887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:17.561567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84902e4-6d49-4bf1-9e5f-8d4ad36498d7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:17.599660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:17.600628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.601140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.601617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.602488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:17.603098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:17.604750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:17.611019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 380/772] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Sep 9 14:45:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:17.619267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:17.797760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bac15-578e-4822-ab2b-48eaef276664 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:17.833529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35720f02-feea-49e7-a306-087600233c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:17.834160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720f02-feea-49e7-a306-087600233c15 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:17.834442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720f02-feea-49e7-a306-087600233c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:17.834712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35720f02-feea-49e7-a306-087600233c15 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:17.835342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35720f02-feea-49e7-a306-087600233c15 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:17.835643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35720f02-feea-49e7-a306-087600233c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:17.837000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35720f02-feea-49e7-a306-087600233c15 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:17.842613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 393/773] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Sep 9 14:45:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:17.848434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:17.874033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35720f02-feea-49e7-a306-087600233c15 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:17.964203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123148d-aa44-440b-a65f-00e42a14566e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:17.999225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:18.003528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:18.004192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.004484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.004758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.005464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] RBAC: Adding query filter params (interface=public, service_id=e2de5b816baf4b2a87bd9a938983d231, region_id=RegionOne) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:18.005771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:18.007720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:18.016820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 381/774] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:45:17 2022] GET /identity/v3/endpoints?service_id=e2de5b816baf4b2a87bd9a938983d231&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:18.022122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:18.065454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:18.137640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824ead-191c-4899-a80f-81246d47eaaf None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:18.149162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35720f02-feea-49e7-a306-087600233c15 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:18.206348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:18.207224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.207503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.207777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.208389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:18.209762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:18.219744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 382/775] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:18 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:18.223495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:18.224143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.224423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.224699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.225347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:18.226776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:18.239589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:18.240622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:18.241476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:18.245435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 394/776] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:17 2022] GET /identity/v3/services/network => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:18.251815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:18.349086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:18.416315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05327-ad3e-4b50-b546-0001a1673cf5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:18.467610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:18.468473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.468473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.468793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.469365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] RBAC: Adding query filter params (name=network) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:18.469659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:18.471054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:18.479338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 383/777] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:18.485515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:18.605813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de69f-c033-450b-8807-36b115205ec1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:18.642685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:18.651637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:18.652255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.652540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.652814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.653450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:18.654434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:18.655821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:18.661003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 395/778] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:18.671173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:18.833655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a88e8-71f8-4638-a52b-7ef99367695f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:18.868768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:18.884131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d275a-3b27-416a-944e-1c375dc07f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:18.884744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d275a-3b27-416a-944e-1c375dc07f66 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.885022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d275a-3b27-416a-944e-1c375dc07f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.885292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d275a-3b27-416a-944e-1c375dc07f66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.885987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d275a-3b27-416a-944e-1c375dc07f66 None admin] RBAC: Adding query filter params (interface=public, service_id=48c2c49ec15c493d8225330c21a72c27, region_id=RegionOne) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:18.886321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d275a-3b27-416a-944e-1c375dc07f66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:18.887682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d275a-3b27-416a-944e-1c375dc07f66 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:18.898529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 384/779] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:45:18 2022] GET /identity/v3/endpoints?service_id=48c2c49ec15c493d8225330c21a72c27&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:18.904448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:18.948032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbbb3-70ac-4e89-aeb3-4c4428e75d37 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.948354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbbb3-70ac-4e89-aeb3-4c4428e75d37 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.948588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbbb3-70ac-4e89-aeb3-4c4428e75d37 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.950234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 385/780] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:18.955535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2288f5-c912-4696-beb6-443ec1b573a7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:18.955812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2288f5-c912-4696-beb6-443ec1b573a7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:18.956135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2288f5-c912-4696-beb6-443ec1b573a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:18.986543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ba2288f5-c912-4696-beb6-443ec1b573a7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:18.987759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ba2288f5-c912-4696-beb6-443ec1b573a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:19.053927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e50f4-fcdb-4b28-b0d9-ec445c3200e8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:19.110653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:19.111290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:19.111569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:19.111843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:19.112455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:19.113823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:19.127587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 396/781] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:18 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:19.134130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 386/782] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:19.432072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:19.491705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:19.527329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff9318-d056-4699-bd2f-50cdf342490b None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:19.527831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff9318-d056-4699-bd2f-50cdf342490b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:19.527907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff9318-d056-4699-bd2f-50cdf342490b None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:19.529533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 387/783] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:19.535048 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eccfd-54ce-4616-8f7d-3384cd1f723c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:19.535611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eccfd-54ce-4616-8f7d-3384cd1f723c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:19.536089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644eccfd-54ce-4616-8f7d-3384cd1f723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:19.550194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbd34-c9eb-4dcd-bb18-d8a8c42655f7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:19.557807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-644eccfd-54ce-4616-8f7d-3384cd1f723c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:19.559292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-644eccfd-54ce-4616-8f7d-3384cd1f723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:19.610916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:19.611569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:19.611844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:19.612121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:19.637176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:19.644161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:19.645086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:19.645948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:19.650823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 397/784] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:19.659782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:19.665053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 388/785] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:19.812893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27680986-ced2-4a56-8bc6-734a17fb8089 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:19.835940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:19.861040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:19.862026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:19.862611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:19.863115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:19.863989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:19.864509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:19.866108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:19.875954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 398/786] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:19.881371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eccfd-54ce-4616-8f7d-3384cd1f723c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:19.959155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:20.030508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.042443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644eccfd-54ce-4616-8f7d-3384cd1f723c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.078264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:20.078892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.079163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.079423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.090196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:20.092198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:20.108016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:20.109117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:20.110234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:20.110234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:20.110234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:20.110234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 389/787] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:20.123509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.176604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88643841-c96a-42be-a71e-406bfc098375 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.211597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0d8a1-88e9-4119-a4c1-d770de494e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:20.212144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0d8a1-88e9-4119-a4c1-d770de494e98 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.212414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0d8a1-88e9-4119-a4c1-d770de494e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.212682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0d8a1-88e9-4119-a4c1-d770de494e98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.223885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0d8a1-88e9-4119-a4c1-d770de494e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a3b0d8a1-88e9-4119-a4c1-d770de494e98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:20.229026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:20.231219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 399/788] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:20.233598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321fcd-3778-4af0-9108-93a6e73260f3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.235589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321fcd-3778-4af0-9108-93a6e73260f3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.235589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321fcd-3778-4af0-9108-93a6e73260f3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.235589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 400/789] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:20.239394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529115f-3389-4411-9238-50ccf67e6195 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.239394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529115f-3389-4411-9238-50ccf67e6195 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.239394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529115f-3389-4411-9238-50ccf67e6195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.243084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:20.247059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0e42-f17a-4fc3-934e-0cc80aac3eca None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.260311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4529115f-3389-4411-9238-50ccf67e6195 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:20.261801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4529115f-3389-4411-9238-50ccf67e6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:20.286052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:20.286686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.288623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.288623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.288623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:20.288623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:20.290023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:20.305747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:20.306026 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 390/790] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:20.308583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.381210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 401/791] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:20.381210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529115f-3389-4411-9238-50ccf67e6195 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.465744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969317e9-79b4-44e8-b20a-7066436483aa None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.532114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:20.532770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.532989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.533254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.533919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:20.534245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:20.535608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:20.555389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 391/792] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:20.559896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.566163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529115f-3389-4411-9238-50ccf67e6195 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.597103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:20.636680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:20.637317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.637593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.637865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.651183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:20.655039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:20.677430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:20.678451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:20.679412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 402/793] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:20.689914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.744100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:20.754406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf992-e3f1-40b7-9bbd-5d6bd675a98e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.797819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:20.798813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.799331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.799820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.812611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:20.814403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:20.829342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06749c-5acb-4acb-9bc9-b74ebb026836 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:20.833245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:20.834193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:20.835097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:20.835097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:20.835097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:20.837315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 392/794] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:20.838343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.868969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:20.869771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:20.870015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:20.870375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:20.871230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:20.871536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:20.873120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:20.893267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 403/795] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:20.894300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:20.931790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:20.970609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d466bd7-8a3f-4382-a48b-4eca0e09a197 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:20.988093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:21.008034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8f915-1fdb-4360-af3a-54c9483b1127 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.015910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.017249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.017713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.018211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.032532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:21.037877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:21.039041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:21.040050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:21.044463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 393/796] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:21.044728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.050295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eb3ac-9bed-42a7-aa5c-97e60bd1f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.050914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb3ac-9bed-42a7-aa5c-97e60bd1f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.051195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb3ac-9bed-42a7-aa5c-97e60bd1f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.051468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eb3ac-9bed-42a7-aa5c-97e60bd1f8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.052116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eb3ac-9bed-42a7-aa5c-97e60bd1f8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:21.052418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eb3ac-9bed-42a7-aa5c-97e60bd1f8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.054225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eb3ac-9bed-42a7-aa5c-97e60bd1f8e4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.067899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 404/797] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:21.069102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffc3df-1d39-4822-bcfb-4422b11336d7 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.069384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffc3df-1d39-4822-bcfb-4422b11336d7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.069655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffc3df-1d39-4822-bcfb-4422b11336d7 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.070866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 405/798] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:21.074373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffc3df-1d39-4822-bcfb-4422b11336d7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.161299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40f280-e1dd-4ea8-ac99-be180b33562e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.179381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffc3df-1d39-4822-bcfb-4422b11336d7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.191934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:21.197729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.198366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.198640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.198906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.216268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.216989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.217318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.217605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.218321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:21.218675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.220085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.235712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 406/799] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:21.235712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.240612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:21.354303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29090beb-25e8-45d8-9d97-bb119cd02951 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.390408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce874fc-a8d0-4e41-b07e-83641b3f7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.391040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce874fc-a8d0-4e41-b07e-83641b3f7e7b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.391320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce874fc-a8d0-4e41-b07e-83641b3f7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.391599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce874fc-a8d0-4e41-b07e-83641b3f7e7b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.398063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.399042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce874fc-a8d0-4e41-b07e-83641b3f7e7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.399527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.400495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce874fc-a8d0-4e41-b07e-83641b3f7e7b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-7ce874fc-a8d0-4e41-b07e-83641b3f7e7b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:21.412763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:21.413997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:21.415201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:21.418642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 407/800] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:21.420196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5abd5-e193-4201-9773-12f5d2bb24b6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.420556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5abd5-e193-4201-9773-12f5d2bb24b6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.420867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5abd5-e193-4201-9773-12f5d2bb24b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.438712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-57e5abd5-e193-4201-9773-12f5d2bb24b6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:21.439910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-57e5abd5-e193-4201-9773-12f5d2bb24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:21.500396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:21.513557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 394/801] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:45:21.513743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 408/802] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:21.513743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5abd5-e193-4201-9773-12f5d2bb24b6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.518364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.565297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:21.625729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5abd5-e193-4201-9773-12f5d2bb24b6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.662396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3bc7-6fb1-4db9-8317-e53b45cf6c1e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.704501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.705152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.705429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.705699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.718342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.719800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:21.735853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:21.737043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:21.738230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:21.738230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:21.738230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:21.741761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 395/803] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:21.742457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.783132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba4879-0877-499a-b167-60a1ce27363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.783737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4879-0877-499a-b167-60a1ce27363d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.784011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4879-0877-499a-b167-60a1ce27363d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.784277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba4879-0877-499a-b167-60a1ce27363d None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.785004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba4879-0877-499a-b167-60a1ce27363d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:21.785306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba4879-0877-499a-b167-60a1ce27363d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.786763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba4879-0877-499a-b167-60a1ce27363d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.804349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 409/804] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:21.805514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca0808-88d9-4187-8e77-3cd4eaab377b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.805796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca0808-88d9-4187-8e77-3cd4eaab377b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.806065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca0808-88d9-4187-8e77-3cd4eaab377b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.807393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 410/805] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:21.807951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca0808-88d9-4187-8e77-3cd4eaab377b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.832558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:21.849133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf56f-9bc2-40b7-bc67-0cfbbe2fa9bb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.861361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:21.882519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.883080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.883357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.883623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.893878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.895342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.909473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca0808-88d9-4187-8e77-3cd4eaab377b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:21.909916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:21.911009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:21.912275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:21.912275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:21.912275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:21.912275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 396/806] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:21.912275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:21.945799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:21.946427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:21.946704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:21.946972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:21.947606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:21.947903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:21.949236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:21.960970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 411/807] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:21.961746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.016219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489e010-c77d-431e-b3c1-f5e5ddd14738 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.049012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4db528-b666-4234-a0ae-d1ddcbf2103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.049635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4db528-b666-4234-a0ae-d1ddcbf2103c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.049910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4db528-b666-4234-a0ae-d1ddcbf2103c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.050213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4db528-b666-4234-a0ae-d1ddcbf2103c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.050788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4db528-b666-4234-a0ae-d1ddcbf2103c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.052129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4db528-b666-4234-a0ae-d1ddcbf2103c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.054609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.059557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c3663-bdc7-464b-9289-69895accf5ff None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7e4db528-b666-4234-a0ae-d1ddcbf2103c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:22.063279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:22.064448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:22.065295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 397/808] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:22.066146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7369-3aae-40a4-bec0-310453698481 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.066146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7369-3aae-40a4-bec0-310453698481 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.066146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd7369-3aae-40a4-bec0-310453698481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.073339 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.084646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-46cd7369-3aae-40a4-bec0-310453698481 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:22.085826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-46cd7369-3aae-40a4-bec0-310453698481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:22.096373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.096995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.097273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.097541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.108084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.109501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:22.124011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:22.125125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:22.126014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:22.126014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:22.126014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:22.126014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 412/809] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:22.126014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.155273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 398/810] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:22.156104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7369-3aae-40a4-bec0-310453698481 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.236465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca974c1-f7a3-4553-ba3f-a2d494a315dd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.262374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd7369-3aae-40a4-bec0-310453698481 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.272117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.272731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.273009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.273283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.273911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:22.274250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.275649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.288287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 413/811] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:22.289414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.298330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.305090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.305725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.306011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.306413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.314624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.315544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.316152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:22.327785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:22.328914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:22.330078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:22.334538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 399/812] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:22.334821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.397891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f777dca-a0c7-4cd4-9045-d03ae6abf75e None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.434066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.434630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.434933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.435201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.435915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:22.436213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.437563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.442499 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 414/813] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:22.442753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ef31-8902-4a6b-8a06-1c4de769dddc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.443461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.476430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.477029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.477303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.477570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.478245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:22.478545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.479874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.491662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 400/814] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:22.492780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.534658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.543576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.547415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b9da1-8955-4072-ba88-861864df666a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.580836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.581457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.581735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.582286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.588660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.590076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.592964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d824e5-3f61-406c-901b-8ed39454ea0b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:22.602020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:22.603067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:22.604239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:22.605150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 415/815] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:22.605961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.628627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.629231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.629512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.629786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.630543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:22.630845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.632260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.650031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 401/816] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:22.650984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.708881 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408fd-304f-4436-bb58-57f31a346a8d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.742931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.743715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.743997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.744271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] PATH_INFO: `/v3/services/network` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.744851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.746247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.749402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea0cbd-8d1e-46be-b819-2f59dbc65bba None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:22.755364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:22.756506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:22.758050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 416/817] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:22.759061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.760061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.773934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.786685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.787288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.787564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.787834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.788453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:22.788751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.790105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.794710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 402/818] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:22.795478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.859275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707ab83-a795-4e70-b4d0-d3695e5d7874 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.891208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184c12-6de5-4edb-8f51-26b806f450ee None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:22.892612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.893229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.893508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.893774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.900285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.901714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:22.912960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:22.914007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:22.915102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 417/819] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:22.915694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.928744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:22.929407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:22.929699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:22.929966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:22.930682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:22.930985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:22.932390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:22.944317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 403/820] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:22.944950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:22.978926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:22.984583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:23.015464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb586fc8-14d7-4295-b36b-0b14d6584262 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.048109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e27ec2-4e11-42d0-8d3e-90dba5d899cf None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.048849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.049478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.049758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.050030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.060953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.062417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:23.076831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:23.077847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:23.079236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:23.079236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:23.079236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:23.079236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 418/821] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:23.079236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.087623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.088227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.088616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.088889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.089504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] RBAC: Adding query filter params (name=network) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:23.089800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.091781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.096709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 404/822] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:23.097454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.178433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa35812-8708-42fc-9640-ed6d0d93e5b0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.194172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:23.200902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9c03b-6496-44e4-afe4-10cc6c4cc3ec None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.201213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:23.212506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.213109 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.213389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.213663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.214379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.215737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.235287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.235818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.236097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.236368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.236876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 419/823] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:23.237063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:23.237345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.237679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.238793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.252589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 405/824] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:23.257964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.373680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff2ad-f02c-4836-a1ea-e9eb7b917747 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.379928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6d84-f7b6-47da-b5bb-c5b13a16330d None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.409271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.409891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.410200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.410479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.411235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=8908c33eb701459298d35fa8ccb80bd2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:23.411549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.412987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.419954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.420685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 420/825] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:23 2022] GET /identity/v3/role_assignments?user.id=8908c33eb701459298d35fa8ccb80bd2&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:23.420962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.421244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.421427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.421541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.422310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:23.422496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.423887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.438452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 406/826] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:23.439493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.464840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:23.474846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:23.552975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf950acf-9c3b-4573-ab29-f27b82d97232 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.587339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260592e-8a80-49e9-8001-5cac9f70aa0b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.594257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.595119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.595572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.596513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.597368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:23.597815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.599783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.608625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 421/827] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:23.609452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.630216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.630871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.631182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.631681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/4dbfce81ff9a43bcbb783a19819ad4a9/roles/6829f18de75049389086cb4eccc75948` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.649531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=4dbfce81ff9a43bcbb783a19819ad4a9, role_id=6829f18de75049389086cb4eccc75948)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.652046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.669989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 407/828] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:45:23 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/4dbfce81ff9a43bcbb783a19819ad4a9/roles/6829f18de75049389086cb4eccc75948 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:45:23.670723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.742403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2fe1b-ec60-4356-9ec7-0c8da8ba86f0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.746904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:23.777115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:23.787196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.788087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.788538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.789640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.798477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.800245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:23.813787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:23.814929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:23.816036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:23.822121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 422/829] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:23.822358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f163da-1dbc-44a5-8013-f7b8f5d89adb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:23.828308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:23.861030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:23.861678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:23.861959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:23.862338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:23.863099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:23.864504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:23.893388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 408/830] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:23.989319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16a235-19fe-4126-a4ae-ea854dc78ee6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:24.038283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971b81d-6dca-40d7-9864-403bfed6f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:24.038988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971b81d-6dca-40d7-9864-403bfed6f486 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:24.039350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971b81d-6dca-40d7-9864-403bfed6f486 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:24.039899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971b81d-6dca-40d7-9864-403bfed6f486 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:24.040474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971b81d-6dca-40d7-9864-403bfed6f486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:24.040856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971b81d-6dca-40d7-9864-403bfed6f486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:24.042393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971b81d-6dca-40d7-9864-403bfed6f486 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:24.057050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 423/831] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:24.063172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:24.198687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943e6e-e34a-4c35-977f-08b77e9b4144 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:24.223021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:24.239574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48d271-72aa-4fa2-b17c-89e92a04ba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:24.240243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d271-72aa-4fa2-b17c-89e92a04ba55 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:24.240523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d271-72aa-4fa2-b17c-89e92a04ba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:24.240793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d271-72aa-4fa2-b17c-89e92a04ba55 None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/c7d4404bc9fb4bae8e8114daecd6409a/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:24.242757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48d271-72aa-4fa2-b17c-89e92a04ba55 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=c7d4404bc9fb4bae8e8114daecd6409a, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:24.244184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48d271-72aa-4fa2-b17c-89e92a04ba55 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:24.262891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 409/832] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:45:24 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/c7d4404bc9fb4bae8e8114daecd6409a/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:45:25.598414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51dce2-014c-4694-8846-6612f6899971 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:25.598968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51dce2-014c-4694-8846-6612f6899971 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:25.599047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51dce2-014c-4694-8846-6612f6899971 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:25.600621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 424/833] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:25.605800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874060bd-a042-4f4b-8763-096fe1724de7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:25.606231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874060bd-a042-4f4b-8763-096fe1724de7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:25.606384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874060bd-a042-4f4b-8763-096fe1724de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:25.625577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-874060bd-a042-4f4b-8763-096fe1724de7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:25.626809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-874060bd-a042-4f4b-8763-096fe1724de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:25.704596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 410/834] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:25.894708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4d8cf-d955-4f3a-b756-4fd71312afc2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:25.895054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4d8cf-d955-4f3a-b756-4fd71312afc2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:25.895264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4d8cf-d955-4f3a-b756-4fd71312afc2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:25.896840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 425/835] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:25.902129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d957-f936-4062-a893-831aead969ab None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:25.902413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d957-f936-4062-a893-831aead969ab None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:25.902685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436d957-f936-4062-a893-831aead969ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:25.926157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7436d957-f936-4062-a893-831aead969ab None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:25.927323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7436d957-f936-4062-a893-831aead969ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:25.975840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4d8cf-d955-4f3a-b756-4fd71312afc2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:25.995869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 411/836] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:25.999644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:26.092599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4d8cf-d955-4f3a-b756-4fd71312afc2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:26.129338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:26.129972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.130280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.130553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.131142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:26.132507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:26.142166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:26.143172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:26.144037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:26.144863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0391-de7a-4ba3-b5ce-bdfb8093bfca None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.144863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0391-de7a-4ba3-b5ce-bdfb8093bfca None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.145014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 426/837] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:26.145090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0391-de7a-4ba3-b5ce-bdfb8093bfca None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.145746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 412/838] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:26.149228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:26.150560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfd043-c0b5-49fe-b91f-ef827fa11a64 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.150841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfd043-c0b5-49fe-b91f-ef827fa11a64 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.151109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfd043-c0b5-49fe-b91f-ef827fa11a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.172947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-eddfd043-c0b5-49fe-b91f-ef827fa11a64 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:26.174702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-eddfd043-c0b5-49fe-b91f-ef827fa11a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:26.223208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:26.249503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:26.266443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 413/839] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:26.268151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a3229-2c3f-487b-b0d6-04783cabff87 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:26.277878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfd043-c0b5-49fe-b91f-ef827fa11a64 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:26.304172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:26.304809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.305150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.305407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.306041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:26.306422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:26.308200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:26.317398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 427/840] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:26.319824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:26.416975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfd043-c0b5-49fe-b91f-ef827fa11a64 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:26.448988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5deb4-073b-45ce-ba79-dbe68ec545da None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:26.464341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b195e-d59e-4657-a339-75ad6b8f2415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:26.464978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b195e-d59e-4657-a339-75ad6b8f2415 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.465256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b195e-d59e-4657-a339-75ad6b8f2415 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.465904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b195e-d59e-4657-a339-75ad6b8f2415 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.466295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b195e-d59e-4657-a339-75ad6b8f2415 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:26.467668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b195e-d59e-4657-a339-75ad6b8f2415 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f42b195e-d59e-4657-a339-75ad6b8f2415 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:26.480686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:26.482394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:26.483396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 414/841] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:26.490956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e887f-c3b2-490b-b248-775deb6d11c8 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.491228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e887f-c3b2-490b-b248-775deb6d11c8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.491500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e887f-c3b2-490b-b248-775deb6d11c8 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.492639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4dd6f-ce7c-4fc9-9571-44b3e5022c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:26.493075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 415/842] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:26.493615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4dd6f-ce7c-4fc9-9571-44b3e5022c4d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.494017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4dd6f-ce7c-4fc9-9571-44b3e5022c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.494458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4dd6f-ce7c-4fc9-9571-44b3e5022c4d None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.495206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4dd6f-ce7c-4fc9-9571-44b3e5022c4d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:26.495628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4dd6f-ce7c-4fc9-9571-44b3e5022c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:26.497172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4dd6f-ce7c-4fc9-9571-44b3e5022c4d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:26.498231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e887f-c3b2-490b-b248-775deb6d11c8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:26.510902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 428/843] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:26.510902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7e5f-432a-4ef5-b302-ae9aca61ac4a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.510902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7e5f-432a-4ef5-b302-ae9aca61ac4a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.510902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7e5f-432a-4ef5-b302-ae9aca61ac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.530715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-05cf7e5f-432a-4ef5-b302-ae9aca61ac4a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:26.532090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-05cf7e5f-432a-4ef5-b302-ae9aca61ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:26.541107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:26.565662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:26.627094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 429/844] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:26.627963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7e5f-432a-4ef5-b302-ae9aca61ac4a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:26.656586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e887f-c3b2-490b-b248-775deb6d11c8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:26.706307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:26.707138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.707630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.707741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.708307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:26.708613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:26.709998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:26.716392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 416/845] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:26.722363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:26.790711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7e5f-432a-4ef5-b302-ae9aca61ac4a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:26.844560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:26.845201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.845474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.845732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.860693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:26.863183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:26.868141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88d156-2563-468f-988f-00bd5df1b9ea None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:26.869105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:26.870006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:45:26.871189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:26.875227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 430/846] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:26.876623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:26.880116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:26.917997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:26.919623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:26.920018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:26.920519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:26.921279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:26.921645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:26.923540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:26.934176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 417/847] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:26.960930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.037067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79f2b-81f1-4e84-89a6-a1d88f1551dd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.087765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.089692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.090137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.090580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.092026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:27.092478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.094814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.106260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a3134-7c9a-4ee4-a439-909b167c117c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.106520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 431/848] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:27.111863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.148765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.149632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.149915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.150379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.165004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:27.172270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:27.173456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:27.174463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:27.175582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 418/849] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:27.181657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.199736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:27.222906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:27.258731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37695f47-a679-41b4-9e4d-f9292c922db8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.314847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.315490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.315771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.316158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.335819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.337275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.337716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfde0f1-5d4a-4a22-9ae7-c7f9011fa223 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:27.357456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:27.358491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:27.359404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:27.359404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:27.359404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:27.363372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 432/850] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:27.364272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.379118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.379733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.380011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.380286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.381246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:27.382005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.383707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.400646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 419/851] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:27.402316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.475592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb7d15-8827-43ca-9084-40784611950c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.493418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:27.510535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:27.522664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.523645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.524072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.524670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.525814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:27.526558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.528093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.529004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa430-b08f-4cd8-a742-cc59b39f6a63 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.547069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 433/852] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:27.552564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.580420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.581304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.582296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.582718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.600460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.602603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:27.624532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:27.625751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:27.626861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:27.626861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:27.626861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:27.633007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 420/853] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:27.635113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.670965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8179ad9-7385-47fa-ae75-2bc978bae7f3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.730802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.732342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.732342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.732526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.740485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.741924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:27.754820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:27.755793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:27.756731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:27.760761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 434/854] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:27.761654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.767632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2507e-6904-4f4e-a41d-310920a16455 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.799469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:27.816758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.817712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.818227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.818708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.820101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:27.820875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.822763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.833548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:27.846704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 421/855] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:27.849199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.874497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f87f7-d48c-4309-b2d5-54f5225bae5c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:27.912178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:27.912768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:27.912970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:27.913238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:27.913963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:27.914289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:27.915706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:27.934730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 435/856] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:27.940217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:27.983436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8697f2f-e2d2-4761-be09-3b03183add13 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.026717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.027597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.028022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.028788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.038108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.040242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:28.056142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:28.057123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:28.058049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 422/857] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:28.065138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.067335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.074605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5040a-5ef2-478e-b610-f2ae3ea8b8c4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.110743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.111698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.112200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.112668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.129560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.177262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13126a-2bff-4e9f-b709-05102ba6fbc5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.182295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.183964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.213362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.213991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.214294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.214563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.215390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:28.215696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.217749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.242854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 423/858] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:28.243768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.283130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.290468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 436/859] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:45:28.302148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.353710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c34d9-fd76-459b-872f-4e72f8ae25d5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.379462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.399561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.400164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.400438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.400704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.437072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cb804-49cc-4a87-84d3-2280b15d8b2a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.478316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.480361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.486170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.486808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.487089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.487359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.502731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.504088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:28.526138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:28.527110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:28.527987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:28.527987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:28.527987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:28.527987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 437/860] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:28.534728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.584640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.600853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 424/861] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:45:28.606070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.627933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.653630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8138f-4e5f-4ef4-bf64-0b94fb56b227 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.695047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.695764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.696121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.696716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.697346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:28.697756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.701986 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.716076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 438/862] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:28.722721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.729174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eda90-2aa0-46cd-bfab-46a9b19daab7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.770891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.771541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.771790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.772014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.789047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.790542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:28.810998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:28.811990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:28.812858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:28.812858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:28.812858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:28.812858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 425/863] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:28.818728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.867054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce86429-5f92-427d-9e89-e6f3fda653e0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.877032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.900776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:28.909508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b123f4-564d-4aab-a1f8-4b31f58e96bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.910169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b123f4-564d-4aab-a1f8-4b31f58e96bd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.910445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b123f4-564d-4aab-a1f8-4b31f58e96bd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.910711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b123f4-564d-4aab-a1f8-4b31f58e96bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.917687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b123f4-564d-4aab-a1f8-4b31f58e96bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.919770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b123f4-564d-4aab-a1f8-4b31f58e96bd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-58b123f4-564d-4aab-a1f8-4b31f58e96bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:28.930883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:28.931762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:28.932648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 439/864] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:28.933150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c505-7ec3-4711-a925-09822d209403 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.933825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c505-7ec3-4711-a925-09822d209403 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.933825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222c505-7ec3-4711-a925-09822d209403 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.935156 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 440/865] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:28.939291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222c505-7ec3-4711-a925-09822d209403 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:28.943801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f2aa-4f50-4a5f-9080-f7b30018df4b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:28.981457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a086b3-8e35-4d51-9b00-505be0b90ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:28.982753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a086b3-8e35-4d51-9b00-505be0b90ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.982969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a086b3-8e35-4d51-9b00-505be0b90ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:28.983244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a086b3-8e35-4d51-9b00-505be0b90ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:28.983878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a086b3-8e35-4d51-9b00-505be0b90ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:28.984175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a086b3-8e35-4d51-9b00-505be0b90ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:28.985528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a086b3-8e35-4d51-9b00-505be0b90ec6 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:28.997475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 426/866] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:28.998924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b7e80-6587-41f6-bf8a-64a485a92b1f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:28.998924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b7e80-6587-41f6-bf8a-64a485a92b1f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.000850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b7e80-6587-41f6-bf8a-64a485a92b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.020620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-438b7e80-6587-41f6-bf8a-64a485a92b1f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:29.021738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-438b7e80-6587-41f6-bf8a-64a485a92b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:29.056129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222c505-7ec3-4711-a925-09822d209403 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:29.096756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:29.097380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.097659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.097928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.098696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:29.099002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:29.100452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:29.103039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 427/867] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:29.104110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b7e80-6587-41f6-bf8a-64a485a92b1f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:29.121033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 441/868] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:29.127200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:29.172512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:29.181649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:29.221305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b7e80-6587-41f6-bf8a-64a485a92b1f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:29.254582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae188c4-9e13-4252-bb8f-764493af7aa6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:29.259717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48403b-7ee5-4b3e-8caa-7cdcf20b0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:29.260345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48403b-7ee5-4b3e-8caa-7cdcf20b0336 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.260630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48403b-7ee5-4b3e-8caa-7cdcf20b0336 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.260904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48403b-7ee5-4b3e-8caa-7cdcf20b0336 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.268217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48403b-7ee5-4b3e-8caa-7cdcf20b0336 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:29.269643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48403b-7ee5-4b3e-8caa-7cdcf20b0336 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-5a48403b-7ee5-4b3e-8caa-7cdcf20b0336 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:29.281376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:29.282632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 428/869] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:29.283534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b807c-5e62-496c-a13d-977f9ab56622 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.284066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b807c-5e62-496c-a13d-977f9ab56622 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.284066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b807c-5e62-496c-a13d-977f9ab56622 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.285440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 429/870] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:29.290037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b807c-5e62-496c-a13d-977f9ab56622 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:29.295982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce95c4-b078-4938-bde7-e0804097f029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:29.296589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce95c4-b078-4938-bde7-e0804097f029 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.296870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce95c4-b078-4938-bde7-e0804097f029 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.297144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce95c4-b078-4938-bde7-e0804097f029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.297861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce95c4-b078-4938-bde7-e0804097f029 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=4dbfce81ff9a43bcbb783a19819ad4a9) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:29.298197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce95c4-b078-4938-bde7-e0804097f029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:29.299623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce95c4-b078-4938-bde7-e0804097f029 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:29.305472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 442/871] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:29 2022] GET /identity/v3/role_assignments?user.id=4dbfce81ff9a43bcbb783a19819ad4a9&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:29.306767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5238d-9272-4ae2-9cbc-93a377dc31df None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.307052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5238d-9272-4ae2-9cbc-93a377dc31df None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.307320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5238d-9272-4ae2-9cbc-93a377dc31df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.327239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-95b5238d-9272-4ae2-9cbc-93a377dc31df None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:29.328482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-95b5238d-9272-4ae2-9cbc-93a377dc31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:29.421095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 443/872] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:29.421950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5238d-9272-4ae2-9cbc-93a377dc31df None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:29.441345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b807c-5e62-496c-a13d-977f9ab56622 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:29.450386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:29.465101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:29.488034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:29.489709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.490060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.490609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.491409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:29.492102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:29.494397 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:29.511208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 430/873] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:29.518155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:29.553334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5238d-9272-4ae2-9cbc-93a377dc31df None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:29.593448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:29.594351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.594823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.595278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.596109 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:29.597679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:29.622619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 444/874] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:29 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:29.651463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356d3bd-9fbf-4ad7-8249-8ae20d8d0be1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:29.699593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20f606-91bd-44e7-bcdc-403ab4572637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:29.700260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20f606-91bd-44e7-bcdc-403ab4572637 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.700599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20f606-91bd-44e7-bcdc-403ab4572637 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.700872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20f606-91bd-44e7-bcdc-403ab4572637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.701650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20f606-91bd-44e7-bcdc-403ab4572637 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=c7d4404bc9fb4bae8e8114daecd6409a) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:29.701958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20f606-91bd-44e7-bcdc-403ab4572637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:29.703803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20f606-91bd-44e7-bcdc-403ab4572637 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:29.710330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:29.711200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 431/875] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:29 2022] GET /identity/v3/role_assignments?user.id=c7d4404bc9fb4bae8e8114daecd6409a&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:29.821220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:29.846554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085a95-84fe-46c0-9df4-56798780607d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:29.886566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389343df-21ad-4029-96af-582149c44170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:29.887490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389343df-21ad-4029-96af-582149c44170 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:29.888473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389343df-21ad-4029-96af-582149c44170 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:29.888895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389343df-21ad-4029-96af-582149c44170 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:29.889726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389343df-21ad-4029-96af-582149c44170 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:29.891311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389343df-21ad-4029-96af-582149c44170 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:29.908662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 445/876] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:29 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:45:31.729576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e60e-14bd-4bae-8368-511862214f7b None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:31.730169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e60e-14bd-4bae-8368-511862214f7b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:31.730169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899e60e-14bd-4bae-8368-511862214f7b None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:31.731897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 432/877] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:31.737341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d87292-c395-4592-b603-c4b1da436052 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:31.737775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d87292-c395-4592-b603-c4b1da436052 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:31.737957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d87292-c395-4592-b603-c4b1da436052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:31.756862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-09d87292-c395-4592-b603-c4b1da436052 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:31.758047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-09d87292-c395-4592-b603-c4b1da436052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:31.836856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 446/878] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:31.939525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22edaf-6a1e-4ae5-acfe-cb89452970c5 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:31.940223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22edaf-6a1e-4ae5-acfe-cb89452970c5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:31.940744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22edaf-6a1e-4ae5-acfe-cb89452970c5 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:31.942571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 433/879] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:31.948124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd4113-b4f1-4cdf-b1fa-a3189f5f801a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:31.948672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd4113-b4f1-4cdf-b1fa-a3189f5f801a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:31.949160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd4113-b4f1-4cdf-b1fa-a3189f5f801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:31.968895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-bcbd4113-b4f1-4cdf-b1fa-a3189f5f801a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:31.970001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bcbd4113-b4f1-4cdf-b1fa-a3189f5f801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:31.978704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c4c7-b541-454d-b7fd-433f5e52d5bb None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:31.978985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c4c7-b541-454d-b7fd-433f5e52d5bb None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:31.979261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385c4c7-b541-454d-b7fd-433f5e52d5bb None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:31.980825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 434/880] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:31.986614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4999e-250a-401e-93c0-5d04cacb207f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:31.986894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4999e-250a-401e-93c0-5d04cacb207f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:31.987166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4999e-250a-401e-93c0-5d04cacb207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.006608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-10e4999e-250a-401e-93c0-5d04cacb207f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:32.007907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-10e4999e-250a-401e-93c0-5d04cacb207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:32.035171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.045849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 447/881] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:32.047341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.088706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 435/882] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:32.116572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd4113-b4f1-4cdf-b1fa-a3189f5f801a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.171331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde6e2d-115a-4c88-a16c-7e2b9b250257 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.171979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde6e2d-115a-4c88-a16c-7e2b9b250257 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.172464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde6e2d-115a-4c88-a16c-7e2b9b250257 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.174283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 436/883] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:32.179382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eff919-14b4-4001-bab4-cd192bd3102a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.179893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eff919-14b4-4001-bab4-cd192bd3102a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.180388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eff919-14b4-4001-bab4-cd192bd3102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.200132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-25eff919-14b4-4001-bab4-cd192bd3102a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:32.201853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-25eff919-14b4-4001-bab4-cd192bd3102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:32.221218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd4113-b4f1-4cdf-b1fa-a3189f5f801a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.259170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.259795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.260076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.260346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.272059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:32.277074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:32.278497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:32.279411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.280699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 437/885] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:32.282151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 448/885] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:32.289152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eff919-14b4-4001-bab4-cd192bd3102a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.358132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.391918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.398787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eff919-14b4-4001-bab4-cd192bd3102a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.417981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.438380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.438993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.439269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.439537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.440649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:32.440954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.442713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.454208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 438/886] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:32.454208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.466142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebcd8a-d6f3-439b-ab73-e757aef40e0a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.503985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.503985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.503985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.503985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.504415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.505422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:32.514572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:32.515585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:32.516457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.520523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 449/887] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:32.521337 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.567945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09364eae-b585-4672-a3cc-b57076293146 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.601596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.602245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.602521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.602784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.603351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.604694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:32.613932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:32.615020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:32.615889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 439/888] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:32.618937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.623073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dae3c-ebd6-4a73-be50-79ed75fd0542 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.642388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.644974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.657268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.657897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.658209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.658481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.669570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.671303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:32.685477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:32.686482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:32.687388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:32.687388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:32.687388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.687388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 450/889] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:32.687388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.725184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f26f0-6315-40be-bc96-5e7933d183c4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.758046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.758675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.758861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.759125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.759737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:32.760032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.761377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.765806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 440/890] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:32.766736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.790661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941ce7f-dd79-4c6f-8ac0-cbe9c7f51aff None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.823075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.823691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.823967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.824235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.824807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.826426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:32.835288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:32.836384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:32.837312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 451/891] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:32.838611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.854405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.867367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47316193-0010-49bb-8c06-18ecff5a9750 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.874661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:32.902133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.902733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.903141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.903865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.904483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:32.904778 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.906460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.915867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 441/892] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:32.915867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:32.940119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461db3fb-408a-4f61-aa53-8c7433f4e96b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:32.973623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:32.974262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:32.974542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:32.974810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:32.975442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:32.975742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:32.977103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:32.988688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 452/893] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:32.989463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.010397 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7631e0-e345-4cf2-9853-c9916d7bca39 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.045126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.045620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.045981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.046363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.046995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:33.047288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.048666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.053536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 442/894] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:33.054115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.072508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.093982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.100748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36f66e-adbb-4363-a750-2ae6799a35d7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.134233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.134827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.135099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.135364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.135984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:33.136281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.137714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.142234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 453/895] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:33.143074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.155631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b5206-d421-4c1d-9623-500bfa354b15 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.191469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.192075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.192356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.192632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.193255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:33.193560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.194943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.214237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 443/896] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:33.214237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.254625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b45b67-5a01-41d6-aa62-9874190e4179 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.296809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.297369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.297644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.298751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.306676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.308137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.310341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:33.321313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:33.322406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 454/897] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:33.323469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.338701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ee6df-e11a-4d09-9007-22b5c7efe37e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.353015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.383042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.383656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.383929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.384199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.384904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] RBAC: Adding query filter params (interface=public, service_id=86f30a44cea040c89fdf8e8999d34936, region_id=RegionOne) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:33.385235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.387181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.393403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 444/898] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/endpoints?service_id=86f30a44cea040c89fdf8e8999d34936&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:33.395707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.449644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466f248-e04b-4386-8224-aa3795fc7f41 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.487279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.487885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.488164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.488435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.489068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:33.489569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.490755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.501819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 455/899] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:33.501819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.509241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e705-eefb-4827-b079-4d1f91decbd1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.547408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.547936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.548213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.548479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.549196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:33.549500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.550936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.573465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 445/900] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:33.573465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.573465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.593279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.612173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2dbcc-7c7d-4cb7-81f7-1f4bb86ebf81 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.648231 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.648840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.649122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.649396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.649999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.651396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.670118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 456/901] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:45:33.670118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.694173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3e1cb-aae2-4fbd-98c5-b512e646f6fe None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.738324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.739381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.739867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.740347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.741277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] RBAC: Adding query filter params (interface=public, service_id=6654770ad00749788418a7e78767a2d9, region_id=RegionOne) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:33.741835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.743360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.754124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 446/902] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/endpoints?service_id=6654770ad00749788418a7e78767a2d9&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:33.755398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:33.811621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6ca1-4dd6-41cf-a3f6-903ffd9e4485 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.840354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.861301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.861989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.862348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.862619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.881285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:33.888423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bd780-3083-47ae-83e4-7a18dd4b2204 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:33.936515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:33.937124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:33.937399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:33.937667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:33.938412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.940675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.942171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:33.943853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:33.947165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 447/903] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:45:34.063656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 457/904] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:45:34.069446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:34.182308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d6b0f-103f-45a2-9dd7-8853f44c97f2 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:34.212990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:34.220305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:34.220941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:34.221214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:34.221483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:34.232980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:34.234518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:34.249702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:34.250705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:34.251597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:34.251597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:34.251597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:34.252235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 448/905] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:34.256900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:34.309233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:34.364523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5cb55-8176-436e-88fa-cf51cab228b9 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:34.400921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:34.401917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:34.402412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:34.402920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:34.404087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:34.404587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:34.406161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:34.417981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 458/906] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:34.427184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:34.535697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718186d-7813-4cdc-a9b5-23e9a6e862dc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:34.572394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:34.573018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:34.573293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:34.573561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:34.580890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:34.582595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:34.594567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:34.595478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:34.596361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 449/907] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:34.601752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:34.723716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6286227-1ccf-45ba-a6bf-a21f346046cf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:34.735466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:34.765188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff782cdf-f117-4467-a936-bbd7981bb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:34.766227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782cdf-f117-4467-a936-bbd7981bb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:34.766716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782cdf-f117-4467-a936-bbd7981bb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:34.767213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff782cdf-f117-4467-a936-bbd7981bb3e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:34.768097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782cdf-f117-4467-a936-bbd7981bb3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:34.768593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782cdf-f117-4467-a936-bbd7981bb3e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:34.770227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff782cdf-f117-4467-a936-bbd7981bb3e6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:34.783228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 459/908] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:34.794234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:34.834805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:34.894787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a42772-a01e-423a-9ab1-80b417ac90b6 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:34.936280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba03177-07b1-4fb9-a856-32e07b80e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:34.936882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03177-07b1-4fb9-a856-32e07b80e10a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:34.937156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03177-07b1-4fb9-a856-32e07b80e10a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:34.937423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba03177-07b1-4fb9-a856-32e07b80e10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:34.938170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03177-07b1-4fb9-a856-32e07b80e10a None admin] RBAC: Adding query filter params (role.id=1d0742c5336d482ca12f0d59a0223e60, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=4dbfce81ff9a43bcbb783a19819ad4a9) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:34.938474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03177-07b1-4fb9-a856-32e07b80e10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:34.939885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba03177-07b1-4fb9-a856-32e07b80e10a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:34.945793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 450/909] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:34 2022] GET /identity/v3/role_assignments?user.id=4dbfce81ff9a43bcbb783a19819ad4a9&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=1d0742c5336d482ca12f0d59a0223e60 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:35.482731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6239-ec87-4796-96ee-fbd992ce8575 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:35.483249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6239-ec87-4796-96ee-fbd992ce8575 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:35.483249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b6239-ec87-4796-96ee-fbd992ce8575 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:35.484819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 460/910] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:35.490251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1812-4214-4e36-b63b-5ccf1555371f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:35.490538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1812-4214-4e36-b63b-5ccf1555371f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:35.490810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea1812-4214-4e36-b63b-5ccf1555371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:35.509626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8dea1812-4214-4e36-b63b-5ccf1555371f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:35.510823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8dea1812-4214-4e36-b63b-5ccf1555371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:35.580274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 451/911] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:35.855391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b6239-ec87-4796-96ee-fbd992ce8575 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:35.967493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b6239-ec87-4796-96ee-fbd992ce8575 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:36.008301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e73a6-7915-4930-81de-7862bcc94ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:36.009281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e73a6-7915-4930-81de-7862bcc94ecb None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.009779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e73a6-7915-4930-81de-7862bcc94ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.010293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e73a6-7915-4930-81de-7862bcc94ecb None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.011170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e73a6-7915-4930-81de-7862bcc94ecb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:36.013418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e73a6-7915-4930-81de-7862bcc94ecb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:36.034487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 461/912] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:35 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:36.107312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b91e6-657c-4782-8a62-d6d84271479d None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.107838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b91e6-657c-4782-8a62-d6d84271479d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.107838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b91e6-657c-4782-8a62-d6d84271479d None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.109464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 452/913] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:36.115914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8c88-8eba-4d07-9140-9d021274afff None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.116517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8c88-8eba-4d07-9140-9d021274afff None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.117001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8c88-8eba-4d07-9140-9d021274afff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.138836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-879c8c88-8eba-4d07-9140-9d021274afff None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:36.140363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-879c8c88-8eba-4d07-9140-9d021274afff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:36.168377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:36.213588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d884e29-cbac-4b1d-baf1-83cbe5aff6ce None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.213879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d884e29-cbac-4b1d-baf1-83cbe5aff6ce None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.214165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d884e29-cbac-4b1d-baf1-83cbe5aff6ce None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.216398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 453/914] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:36.221988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ff39-3f61-47a4-9ea3-2c0f7c3ee732 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.222422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ff39-3f61-47a4-9ea3-2c0f7c3ee732 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.222695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1ff39-3f61-47a4-9ea3-2c0f7c3ee732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.231437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 462/915] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:36.244410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c2b1ff39-3f61-47a4-9ea3-2c0f7c3ee732 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:36.245585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c2b1ff39-3f61-47a4-9ea3-2c0f7c3ee732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:36.276719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:36.316009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 454/916] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:36.505196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8c88-8eba-4d07-9140-9d021274afff None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:36.600856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ff39-3f61-47a4-9ea3-2c0f7c3ee732 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:36.611863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8c88-8eba-4d07-9140-9d021274afff None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:36.648204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:36.649202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.649706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.650203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.650995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:36.652555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:36.663137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:36.664135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 14:45:36.664974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:36.667659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 463/917] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:36.674402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:36.704675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:36.722801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1ff39-3f61-47a4-9ea3-2c0f7c3ee732 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:36.769064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:36.769630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.769908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.770207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.770797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:36.772223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:36.784000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:36.785023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 14:45:36.785891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:36.790421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 455/918] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Sep 9 14:45:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:36.791767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:36.807713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4195c8c-8a5e-4996-afca-2752c1e343d7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:36.830039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:36.847501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:36.848601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.849075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.849536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.850415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:36.850911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:36.852533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:36.862888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 464/919] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:36.864011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:36.913920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb48e0-3eaf-4e3a-9cd8-9513a3b40b3f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:36.952131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:36.957565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:36.958421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:36.958860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:36.959273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:36.960074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:36.961171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:36.962995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:36.974523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669d0f7-ac4c-4c09-9b25-92dc387d84e4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:36.974859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 456/920] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:36.976638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:37.014209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:37.015281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.015281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.015713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.016715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:37.017117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:37.018996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:37.029758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 465/921] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Sep 9 14:45:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:37.030557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:37.101234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:37.110596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7010d-b526-447d-bc97-7a228670bed1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:37.152711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e2768-390b-4172-8bea-ae5ce8e63643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:37.153794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e2768-390b-4172-8bea-ae5ce8e63643 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.154206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e2768-390b-4172-8bea-ae5ce8e63643 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.154576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e2768-390b-4172-8bea-ae5ce8e63643 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.155302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e2768-390b-4172-8bea-ae5ce8e63643 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:37.155713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e2768-390b-4172-8bea-ae5ce8e63643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:37.157297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e2768-390b-4172-8bea-ae5ce8e63643 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:37.163580 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 457/922] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:37.164950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d195e-f8f5-4c91-978f-4e96f60c7558 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.165325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d195e-f8f5-4c91-978f-4e96f60c7558 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.165704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d195e-f8f5-4c91-978f-4e96f60c7558 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.167480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 458/923] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:37.171423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5802-0e08-4250-91e7-08016e2d9969 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:37.172358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5fcc-5e95-4e57-b6d3-7b917eb7874f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.172640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5fcc-5e95-4e57-b6d3-7b917eb7874f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.172906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c5fcc-5e95-4e57-b6d3-7b917eb7874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.191623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e75c5fcc-5e95-4e57-b6d3-7b917eb7874f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:37.192799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e75c5fcc-5e95-4e57-b6d3-7b917eb7874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:37.207618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:37.208221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.208504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.208778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.209449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:37.210830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:37.234134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 466/924] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:37.234134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:37.243270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:37.285252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 459/925] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:37.368468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d979546-1a8f-493c-8df6-d7dab9802e56 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:37.407703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:37.408336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.408616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.408883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.409637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:37.411141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:37.439349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 467/926] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:37.569677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c5fcc-5e95-4e57-b6d3-7b917eb7874f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:37.660391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:37.680223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c5fcc-5e95-4e57-b6d3-7b917eb7874f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:37.724884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:37.725518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.725795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.726065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.737570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:37.742478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:37.743388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:37.744389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 460/927] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Sep 9 14:45:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:37.752076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:37.817731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:37.864529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d08d-b047-4788-9057-66c5df199f92 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:37.898822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:37.899430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:37.899708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:37.899982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:37.900646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:37.900946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:37.902335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:37.911862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 468/928] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Sep 9 14:45:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:37.917672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.027661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595855c1-3da5-4016-802f-8a9ec276daa8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:38.064877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:38.065514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.065792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.066065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.075355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:38.079000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:38.080826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:38.096457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:38.097482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:38.098708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:38.098708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:38.098708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:38.098708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 461/929] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:38.104991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.218929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5927721-d67a-4442-a1bd-e926783f1b38 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:38.239887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:38.255564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffcc122-d2e7-4318-8c8c-ff24b2eeb69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:38.256195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc122-d2e7-4318-8c8c-ff24b2eeb69e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.256474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc122-d2e7-4318-8c8c-ff24b2eeb69e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.256747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffcc122-d2e7-4318-8c8c-ff24b2eeb69e None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.257407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcc122-d2e7-4318-8c8c-ff24b2eeb69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:38.257773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcc122-d2e7-4318-8c8c-ff24b2eeb69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:38.259302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffcc122-d2e7-4318-8c8c-ff24b2eeb69e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:38.276947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 469/930] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:38.282634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.286081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336979d6-81f5-410b-9b48-ee1aefa02cf2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.286395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336979d6-81f5-410b-9b48-ee1aefa02cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.286667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336979d6-81f5-410b-9b48-ee1aefa02cf2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.288208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 470/931] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:38.293094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624de4a-eac2-4a54-9dc1-fe8485c8a78f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.293373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624de4a-eac2-4a54-9dc1-fe8485c8a78f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.294218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624de4a-eac2-4a54-9dc1-fe8485c8a78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.317949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e624de4a-eac2-4a54-9dc1-fe8485c8a78f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:38.319176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e624de4a-eac2-4a54-9dc1-fe8485c8a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:38.394805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 471/932] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:38.407065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7248e90-5b6d-4b16-adc4-fb3c7915a04f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:38.442779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:38.443458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.443737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.444057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.452499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:38.454003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:38.467706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:38.468707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:38.469907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 462/933] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:45:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:38.477250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624de4a-eac2-4a54-9dc1-fe8485c8a78f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.582418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624de4a-eac2-4a54-9dc1-fe8485c8a78f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:38.594719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:38.620299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:38.620904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.621181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.621450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.622387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:38.622701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:38.624187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:38.642335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 472/934] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Sep 9 14:45:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:38.648308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.660329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.730282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:38.784389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d065a-5cfc-4834-8d6e-7047839e9677 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:38.791294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6278a0e-0d71-4f26-ad4c-e60fe4faf3c1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:38.825033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:38.826787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.827283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.828045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.833697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:38.834345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:38.834619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:38.834887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:38.835469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:38.836825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:38.843992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:38.845747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:38.846620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:38.847607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:38.848481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:38.853451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 473/935] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:38.854315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:38.872254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:38.873250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:38.874796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:38.874796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:38.874796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:38.878346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 463/936] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:38.879321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:38.900814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:38.995156 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4e84e-4706-43f6-b843-35d7668331f4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.001368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f059b-074f-4498-8a29-f64e5d6ee7e4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.004973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:39.031238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.032170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.032467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.032739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.033558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:39.033973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.035541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.042251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 474/937] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:39.046302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.047172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.047712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.048186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.048491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:39.049275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:39.049778 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.051497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.065280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 464/938] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:39.071827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:39.178871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:39.188976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2463d-f918-4c04-83c9-6e54760522ec None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.190665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c4aff-373e-4baf-ab0d-ad89bfeee42a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.232659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.233264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.233876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.234190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.234310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.234489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.234965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.235083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:39.235443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.235760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.236861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.246306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 475/939] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:39.249117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:39.250213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:39.264812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:39.265749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:39.270983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 465/940] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:39.272578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:39.303206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:39.366982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4856aaa-f229-4af8-81dc-c644750a5b2a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.398313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de3d69-6af5-4b83-ad1d-0b156de6add2 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.405425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.406051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.406357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.406631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.407336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] RBAC: Adding query filter params (interface=public, service_id=dbca0375c65144d991b560584b932ac6, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:39.407646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.409792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.422564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 476/941] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:45:39 2022] GET /identity/v3/endpoints?service_id=dbca0375c65144d991b560584b932ac6&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:39.423755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:39.441816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.442919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.443415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.443893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.445047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:39.445990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.447645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.454012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:39.471363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 466/942] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:39.472721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:39.560674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f30f-467e-4471-afc6-d27458f2b90a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.589284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:39.603887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de124d29-648c-4ee0-a142-b58400bafe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.605070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de124d29-648c-4ee0-a142-b58400bafe1f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.605587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de124d29-648c-4ee0-a142-b58400bafe1f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.606124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de124d29-648c-4ee0-a142-b58400bafe1f None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.606374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774992d2-e499-42fa-af0d-16f3a0449816 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:39.607234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de124d29-648c-4ee0-a142-b58400bafe1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.609995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de124d29-648c-4ee0-a142-b58400bafe1f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.617124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 477/943] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:39 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:45:39.618799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af228c33-aaf9-40ab-a803-116253ca9084 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.619080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af228c33-aaf9-40ab-a803-116253ca9084 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.619347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af228c33-aaf9-40ab-a803-116253ca9084 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.621376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 478/944] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:39.627469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde86b3-3260-46e8-9fc3-c8f519735bc2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.627851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde86b3-3260-46e8-9fc3-c8f519735bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.628189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde86b3-3260-46e8-9fc3-c8f519735bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.645785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e1e7f-257d-4193-80c4-e670b5240fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:39.646600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e1e7f-257d-4193-80c4-e670b5240fcc None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.646982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e1e7f-257d-4193-80c4-e670b5240fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.647321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e1e7f-257d-4193-80c4-e670b5240fcc None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/4dbfce81ff9a43bcbb783a19819ad4a9/roles/1d0742c5336d482ca12f0d59a0223e60` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.650334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e1e7f-257d-4193-80c4-e670b5240fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=4dbfce81ff9a43bcbb783a19819ad4a9, role_id=1d0742c5336d482ca12f0d59a0223e60)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:39.652052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e1e7f-257d-4193-80c4-e670b5240fcc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:39.654904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fbde86b3-3260-46e8-9fc3-c8f519735bc2 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:39.657202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fbde86b3-3260-46e8-9fc3-c8f519735bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:39.673228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 467/945] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:45:39 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/4dbfce81ff9a43bcbb783a19819ad4a9/roles/1d0742c5336d482ca12f0d59a0223e60 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:45:39.753119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 479/946] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:39.828388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc72d1-1451-4535-b2cd-8e1141bbee41 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.828582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc72d1-1451-4535-b2cd-8e1141bbee41 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.828847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc72d1-1451-4535-b2cd-8e1141bbee41 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.830752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 468/947] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:39.836700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f88ac-4176-462a-9fab-10e9ff0192e1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:39.837543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f88ac-4176-462a-9fab-10e9ff0192e1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:39.837997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f88ac-4176-462a-9fab-10e9ff0192e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:39.858917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d13f88ac-4176-462a-9fab-10e9ff0192e1 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:39.860138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d13f88ac-4176-462a-9fab-10e9ff0192e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:39.876987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:39.935999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 480/948] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:40.047293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc72d1-1451-4535-b2cd-8e1141bbee41 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:40.154003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc72d1-1451-4535-b2cd-8e1141bbee41 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:40.189418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:40.190457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:40.190939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:40.191409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:40.192265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:40.193897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:40.196711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING keystone.server.flask.common [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 14:45:40.208874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f88ac-4176-462a-9fab-10e9ff0192e1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:40.213135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:40.217131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.sql.core [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 14:45:40.217131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 14:45:40.217131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [parameters: {'id': 'a22c6163bde244d39a129a065306d1f7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 14:45:40.217131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81511) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a22c6163bde244d39a129a065306d1f7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a22c6163bde244d39a129a065306d1f7. Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application conn.query(q) Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 14:45:40.239599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result.read() Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 14:45:40.240478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application next(self.gen) Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application yield resource Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application next(self.gen) Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise self.value Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application session.commit() Sep 09 14:45:40.241401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.session.flush() Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application compat.raise_( Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 14:45:40.242288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 14:45:40.243191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application conn.query(q) Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result.read() Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 14:45:40.243976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [parameters: {'id': 'a22c6163bde244d39a129a065306d1f7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:40.247623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:40.249517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a22c6163bde244d39a129a065306d1f7. Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 469/949] 10.222.0.52 () {60 vars in 1140 bytes} [Fri Sep 9 14:45:40 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:40.251660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:40.326726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f88ac-4176-462a-9fab-10e9ff0192e1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:40.364231 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:40.365243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:40.365715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:40.366251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:40.367025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:40.368622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:40.378910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:40.379918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:40.380750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:40.381474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030974dc-dd1d-494f-8e43-541a25898b6a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:40.383887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 481/950] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:40.390053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:40.407628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:40.430034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:40.431834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:40.432358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:40.432858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:40.442574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:40.445251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:40.460482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:40.461406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:40.462331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:40.465609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 470/951] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:40.477394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:40.504973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9adb-5643-40d1-9d26-1280431acc0b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:40.540808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:40.541424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:40.541698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:40.541967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:40.542688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:40.542988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:40.544586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:40.549856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 482/952] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:40.550294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:40.559138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:40.612535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50058381-8d46-4c4a-a3a0-36973d0f89db None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:40.655937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead01a-0894-4430-a016-4e2504755f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:40.656742 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead01a-0894-4430-a016-4e2504755f1e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:40.657283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:40.658508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead01a-0894-4430-a016-4e2504755f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:40.659259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead01a-0894-4430-a016-4e2504755f1e None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:40.660476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ead01a-0894-4430-a016-4e2504755f1e None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:40.661007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ead01a-0894-4430-a016-4e2504755f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:40.663873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ead01a-0894-4430-a016-4e2504755f1e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:40.686192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b1fe2-908c-4884-ba66-7ffe4cfd6b6b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:40.694584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 471/953] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:40.732267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6948a6b-cafd-48a5-9442-84bb489c1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:40.733329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948a6b-cafd-48a5-9442-84bb489c1e02 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:40.733818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948a6b-cafd-48a5-9442-84bb489c1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:40.734556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6948a6b-cafd-48a5-9442-84bb489c1e02 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:40.735446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948a6b-cafd-48a5-9442-84bb489c1e02 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:40.735963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948a6b-cafd-48a5-9442-84bb489c1e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:40.737606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6948a6b-cafd-48a5-9442-84bb489c1e02 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:40.749811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 483/954] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:41.876792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3cb39-cbbd-43a8-889e-95f248f94ef9 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:41.877342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3cb39-cbbd-43a8-889e-95f248f94ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:41.877342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3cb39-cbbd-43a8-889e-95f248f94ef9 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:41.879058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 472/955] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:41.884534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8f97-4b7b-4b63-99ee-1c63d9bd1e72 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:41.884925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8f97-4b7b-4b63-99ee-1c63d9bd1e72 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:41.885095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b8f97-4b7b-4b63-99ee-1c63d9bd1e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:41.904827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0f0b8f97-4b7b-4b63-99ee-1c63d9bd1e72 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:41.906021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0f0b8f97-4b7b-4b63-99ee-1c63d9bd1e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:41.941237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bd03f-574c-4cce-bc3a-2dec21b95d30 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:41.941557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bd03f-574c-4cce-bc3a-2dec21b95d30 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:41.941780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bd03f-574c-4cce-bc3a-2dec21b95d30 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:41.943390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 473/956] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:41.948181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c215-3fff-44b9-9182-e9c392d30260 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:41.948460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c215-3fff-44b9-9182-e9c392d30260 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:41.948730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5c215-3fff-44b9-9182-e9c392d30260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:41.968306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ddc5c215-3fff-44b9-9182-e9c392d30260 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:41.969722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ddc5c215-3fff-44b9-9182-e9c392d30260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:41.981774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 484/957] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:42.046513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 474/958] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:42.254898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b8f97-4b7b-4b63-99ee-1c63d9bd1e72 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.319741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5c215-3fff-44b9-9182-e9c392d30260 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.328923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:42.370523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b8f97-4b7b-4b63-99ee-1c63d9bd1e72 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:42.380865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:42.412328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:42.412958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:42.413232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:42.413501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:42.414470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:42.416138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:42.427847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:42.429013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:42.435218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 485/959] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:42.437871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.440962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5c215-3fff-44b9-9182-e9c392d30260 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:42.486109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:42.486816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:42.487091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:42.487359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:42.501051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:42.507389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:42.508295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:42.509150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:42.514812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 475/960] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Sep 9 14:45:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:42.516147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.558464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290749dc-1099-46c8-8b24-dd3d852c1d87 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:42.598253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:42.599333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:42.599820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:42.600329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:42.601170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:42.601745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:42.603548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:42.604827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:42.616037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 486/961] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:42.617526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.637936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ae9ec-edc1-4ef6-b240-3d30195febb1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:42.651610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:42.680572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:42.681183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:42.681604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:42.682001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:42.686108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:42.686108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:42.686108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:42.694567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 476/962] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Sep 9 14:45:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:42.702822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.748267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c528-4efb-4bce-b0d5-73aa8bbd1580 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:42.784923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:42.785953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:42.786512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:42.787015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:42.787944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:42.788452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:42.790159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:42.800889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 487/963] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:42.802579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.824490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3353a-5a61-4fdf-ac13-604faf96f269 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:42.871358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:42.872571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:42.872850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:42.873117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:42.877831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:42.888249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:42.889877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:42.909446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:42.910556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:42.911478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:42.911478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:42.911478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:42.913889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 477/964] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:42.922391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:42.932722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16680b-b54b-4fda-b4b5-1f0d793d8ae4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:42.957474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:42.974882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8654d21-eaae-4c81-b778-3901c210136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:42.975499 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8654d21-eaae-4c81-b778-3901c210136e None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:42.975780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8654d21-eaae-4c81-b778-3901c210136e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:42.976054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8654d21-eaae-4c81-b778-3901c210136e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:42.976720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8654d21-eaae-4c81-b778-3901c210136e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:42.978129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8654d21-eaae-4c81-b778-3901c210136e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:43.002264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 488/965] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:45:43.003553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5f4a-4db0-4db2-9172-a71d17bff56d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.003838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5f4a-4db0-4db2-9172-a71d17bff56d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.004110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5f4a-4db0-4db2-9172-a71d17bff56d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.005388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 489/966] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:43.016822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb893a-202d-4bdf-9502-c7f19a5dd248 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.017145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb893a-202d-4bdf-9502-c7f19a5dd248 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.017386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb893a-202d-4bdf-9502-c7f19a5dd248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.047356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-96bb893a-202d-4bdf-9502-c7f19a5dd248 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:43.048879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-96bb893a-202d-4bdf-9502-c7f19a5dd248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:43.061667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5f4c0-eb01-466a-9c3d-3046f7dd785e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:43.109535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:43.110186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.110469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.110740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.111383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:43.111685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:43.113066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:43.134118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 490/967] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:43.134366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 478/968] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:43.134462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c46d-cd72-4c08-90b3-a16686bef8d6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.134462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c46d-cd72-4c08-90b3-a16686bef8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.134462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684c46d-cd72-4c08-90b3-a16686bef8d6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.134462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 491/969] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:43.134778 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:43.136495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eddd59-cf98-409a-b1c9-e52635a12c4c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.136773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eddd59-cf98-409a-b1c9-e52635a12c4c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.137113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eddd59-cf98-409a-b1c9-e52635a12c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.158007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-14eddd59-cf98-409a-b1c9-e52635a12c4c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:43.159263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-14eddd59-cf98-409a-b1c9-e52635a12c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:43.225595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:43.235745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:43.264202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117291-a2a7-4fd3-8b84-1f864d18a01b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:43.271254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 492/970] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:43.307096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:43.308089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.308551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.309192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.317077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:43.318769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:43.331320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:43.332571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 14:45:43.333591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:43.335782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 479/971] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:45:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:43.344090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eddd59-cf98-409a-b1c9-e52635a12c4c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:43.420792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:43.467392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eddd59-cf98-409a-b1c9-e52635a12c4c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:43.518948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:43.520093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.520938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.521368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.522636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:43.523341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:43.525650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:43.530031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a93ef-d51b-4714-99e6-11d8f89a5b4f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:43.550898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 493/972] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Sep 9 14:45:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:43.555960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:43.573316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:43.574057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.574367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.574764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.575486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:43.577383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:43.589367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:43.594286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:43.602256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 480/973] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:43 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:45:43.602256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:43.689543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b76f04-0712-4f88-9f66-d8528521d15c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:43.742216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:43.743098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.743815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.744280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.767881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70810e85-5882-4b8b-a8fe-9f71d3741fe8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:43.816556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:43.816800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:43.817079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:43.817347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:43.817981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:43.819445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:43.834944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.sql.core [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 14:45:43.834944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 14:45:43.834944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [parameters: {'user_id': '7b974bca58ca413a9a9db8bb5b97182c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 14:45:43.834944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81511) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 14:45:43.838676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:43.840833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application conn.query(q) Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result.read() Sep 09 14:45:43.843799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 14:45:43.844700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application next(self.gen) Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application yield resource Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application next(self.gen) Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise self.value Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application session.commit() Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 14:45:43.845633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.session.flush() Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application compat.raise_( Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 14:45:43.846545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 14:45:43.847447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application conn.query(q) Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application result.read() Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 14:45:43.848305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [parameters: {'user_id': '7b974bca58ca413a9a9db8bb5b97182c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:43.849139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 14:45:43.849922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 14:45:43.853126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 14:45:43.853126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 14:45:43.853126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 14:45:43.853126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 14:45:43.853126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 14:45:43.853126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:43.853126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 481/974] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Sep 9 14:45:43 2022] POST /identity/v3/users => generated 160 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:43.859924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:43.876503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:43.946593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:43.955613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 494/975] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:43 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:45:43.961742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:43.998968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9875-aa5a-435e-8c5a-42f0efc8a1b5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:44.036097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:44.037006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:44.037559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:44.037980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:44.047537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:44.049605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:44.061983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:44.063204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 14:45:44.064356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:44.071093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359b054-f8c3-4813-b6d1-af3c78ae8518 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:44.071393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 482/976] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:44.072896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:44.100855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:44.107918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:44.108624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:44.108969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:44.109304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:44.119868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:44.121417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:44.136135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:44.137866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:44.139021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:44.139021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:44.139021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:44.144501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 495/977] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:44.145546 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:44.190328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15afb6-4ac9-4756-aa0f-aaf6ff2f60f4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:44.217167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:44.229955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:44.230941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:44.231406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:44.231964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:44.232847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:44.233329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:44.235712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:44.253965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640de754-dc68-4556-a17c-d2a4177f752c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:44.286336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 483/978] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Sep 9 14:45:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:44.298874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:44.299506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:44.299779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:44.300045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:44.300696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:44.300994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:44.302426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:44.316511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 496/979] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:44.322471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:44.444199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f0950-819c-4548-982c-e8c5aa2f9b35 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:44.482366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:44.483242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:44.483663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:44.484076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:44.491678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:44.493094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:44.505725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:44.506738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:44.508045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 484/980] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:44.512719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:44.562600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:44.620925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed74618-84df-40ea-836a-a661dbda68a4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:44.659720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9f9e-54a4-427e-b2c9-c3bd4f097a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:44.660334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9f9e-54a4-427e-b2c9-c3bd4f097a3c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:44.660614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9f9e-54a4-427e-b2c9-c3bd4f097a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:44.660889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9f9e-54a4-427e-b2c9-c3bd4f097a3c None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:44.661586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9f9e-54a4-427e-b2c9-c3bd4f097a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:44.661893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9f9e-54a4-427e-b2c9-c3bd4f097a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:44.663373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9f9e-54a4-427e-b2c9-c3bd4f097a3c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:44.675343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 497/981] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:44.681501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:44.731787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:44.792166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733bd62-42a9-4b81-89cd-97e94d76b8ae None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:44.827294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fd566-afd6-4c30-8ee1-b0c369d28748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:44.827903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fd566-afd6-4c30-8ee1-b0c369d28748 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:44.828181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fd566-afd6-4c30-8ee1-b0c369d28748 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:44.828453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fd566-afd6-4c30-8ee1-b0c369d28748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:44.829169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fd566-afd6-4c30-8ee1-b0c369d28748 None admin] RBAC: Adding query filter params (role.id=1d0742c5336d482ca12f0d59a0223e60, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=4dbfce81ff9a43bcbb783a19819ad4a9) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:44.829476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fd566-afd6-4c30-8ee1-b0c369d28748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:44.830912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fd566-afd6-4c30-8ee1-b0c369d28748 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:44.842198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 485/982] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:44 2022] GET /identity/v3/role_assignments?user.id=4dbfce81ff9a43bcbb783a19819ad4a9&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=1d0742c5336d482ca12f0d59a0223e60 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:45.260414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8104-a027-498f-a015-5c863da92620 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:45.260957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8104-a027-498f-a015-5c863da92620 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:45.260957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8104-a027-498f-a015-5c863da92620 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:45.263096 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 498/983] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:45.268325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392395e-7e37-40b1-8d84-a3a219c1d710 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:45.268764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392395e-7e37-40b1-8d84-a3a219c1d710 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:45.268868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392395e-7e37-40b1-8d84-a3a219c1d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:45.288581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3392395e-7e37-40b1-8d84-a3a219c1d710 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:45.290135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3392395e-7e37-40b1-8d84-a3a219c1d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:45.360217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 486/984] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:45.631112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8104-a027-498f-a015-5c863da92620 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:45.749299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8104-a027-498f-a015-5c863da92620 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:45.751891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:45.784973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1430fa5-b46d-4ce9-b4d2-0b03e5c82e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:45.785605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1430fa5-b46d-4ce9-b4d2-0b03e5c82e28 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:45.785885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1430fa5-b46d-4ce9-b4d2-0b03e5c82e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:45.786185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1430fa5-b46d-4ce9-b4d2-0b03e5c82e28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:45.786771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1430fa5-b46d-4ce9-b4d2-0b03e5c82e28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:45.788141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1430fa5-b46d-4ce9-b4d2-0b03e5c82e28 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b1430fa5-b46d-4ce9-b4d2-0b03e5c82e28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:45.797333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:45.798445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:45.803064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 499/985] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:45.804972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392395e-7e37-40b1-8d84-a3a219c1d710 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:45.842713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:45.911058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392395e-7e37-40b1-8d84-a3a219c1d710 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:45.942599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6b40f-deaf-4038-b7b3-4c57786f3779 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:45.942896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6b40f-deaf-4038-b7b3-4c57786f3779 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:45.943161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6b40f-deaf-4038-b7b3-4c57786f3779 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:45.944609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 500/986] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:45.945556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:45.946123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:45.946399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:45.946665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:45.947288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:45.947587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:45.948966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:45.949417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171f8d-7515-43bc-89b4-178556cf069a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:45.950322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171f8d-7515-43bc-89b4-178556cf069a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:45.950322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19171f8d-7515-43bc-89b4-178556cf069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:45.955203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 487/987] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:45.961844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:45.972085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-19171f8d-7515-43bc-89b4-178556cf069a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:45.973272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-19171f8d-7515-43bc-89b4-178556cf069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:46.050640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 501/988] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:46.066140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:46.070568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587ce29-a87f-4f7c-92fd-10b8440e4fc4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:46.107237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:46.107843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:46.108121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:46.108391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:46.109013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:46.109599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:46.110990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:46.120752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 488/989] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:46.122406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171f8d-7515-43bc-89b4-178556cf069a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:46.219176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:46.223360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19171f8d-7515-43bc-89b4-178556cf069a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:46.257849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:46.258717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:46.259215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:46.259674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:46.260557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] RBAC: Adding query filter params (interface=admin, service_id=dbca0375c65144d991b560584b932ac6, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:46.261473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:46.263166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:46.268624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 502/990] 10.222.0.52 () {56 vars in 1249 bytes} [Fri Sep 9 14:45:46 2022] GET /identity/v3/endpoints?service_id=dbca0375c65144d991b560584b932ac6&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:46.274248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:46.336518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:46.381197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2279a3b-9f10-492c-85fb-f6fe9d2ef208 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:46.418918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:46.419534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:46.419813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:46.420084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:46.420682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:46.422037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:46.428891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 489/991] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:46 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:45:46.450899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a40788-8432-4cb1-b992-834138f8beb8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:46.491756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:46.492328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:46.492605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:46.492866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:46.493475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:46.494929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:46.505600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:46.506740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:46.507587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:46.509061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 503/992] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:46.513190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:46.542538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:46.625277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c7d7-43ac-4285-9551-293109cf20cc None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:46.660934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:46.661557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:46.661823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:46.662098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:46.662735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:46.663034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:46.664373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:46.669356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 490/993] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:46.674949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:46.709465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:46.786902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68414a64-62ad-4952-a1c3-206e5325fbf5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:46.821375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:46.821991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:46.822292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:46.822567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:46.823194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:46.823501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:46.824928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:46.834892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 504/994] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:46.836368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:46.935957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:46.946420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4151-83a5-4061-b176-fb39ea02e298 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:46.983204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48bfa-d72e-4ac7-8ec6-ad5d5e1e0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:46.983876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48bfa-d72e-4ac7-8ec6-ad5d5e1e0da4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:46.984159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48bfa-d72e-4ac7-8ec6-ad5d5e1e0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:46.984431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48bfa-d72e-4ac7-8ec6-ad5d5e1e0da4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:46.985134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a48bfa-d72e-4ac7-8ec6-ad5d5e1e0da4 None admin] RBAC: Adding query filter params (interface=public, service_id=8ce7268ce85841e19bc254b8dbf90bad, region_id=RegionOne) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:46.985441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a48bfa-d72e-4ac7-8ec6-ad5d5e1e0da4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:46.986829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a48bfa-d72e-4ac7-8ec6-ad5d5e1e0da4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:46.996522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 491/995] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:45:46 2022] GET /identity/v3/endpoints?service_id=8ce7268ce85841e19bc254b8dbf90bad&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:46.997741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:47.011374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865907af-e50b-40c8-ad9e-a9037bb65380 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:47.011654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865907af-e50b-40c8-ad9e-a9037bb65380 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:47.012050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865907af-e50b-40c8-ad9e-a9037bb65380 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:47.013509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 492/996] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:47.018283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f136cb-c7cd-4ef9-b060-02d5b0a42fee None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:47.018563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f136cb-c7cd-4ef9-b060-02d5b0a42fee None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:47.018833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f136cb-c7cd-4ef9-b060-02d5b0a42fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:47.038950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-87f136cb-c7cd-4ef9-b060-02d5b0a42fee None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:47.039932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-87f136cb-c7cd-4ef9-b060-02d5b0a42fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:47.092724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:47.104351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec425ad-7543-4858-9031-d61abaa7939f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:47.112979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 493/997] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:47.141301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:47.141913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:47.142214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:47.142483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:47.143079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:47.144426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:47.158119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 505/998] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:46 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:45:47.382260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f136cb-c7cd-4ef9-b060-02d5b0a42fee None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:47.468804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:47.488839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f136cb-c7cd-4ef9-b060-02d5b0a42fee None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:47.527179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:47.528665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:47.529104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:47.529382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] PATH_INFO: `/v3/services/image` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:47.529966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:47.531368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:47.540144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:47.541260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:47.542132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:47.546187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 494/999] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Sep 9 14:45:47 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:47.548229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:47.653102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c62a9-880a-4182-ae07-d886ee3d3558 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:47.691805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417ea9a-b368-44e9-9138-1a11fe3fea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:47.692426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417ea9a-b368-44e9-9138-1a11fe3fea24 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:47.692706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417ea9a-b368-44e9-9138-1a11fe3fea24 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:47.692981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417ea9a-b368-44e9-9138-1a11fe3fea24 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:47.693610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417ea9a-b368-44e9-9138-1a11fe3fea24 None admin] RBAC: Adding query filter params (name=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:47.693914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417ea9a-b368-44e9-9138-1a11fe3fea24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:47.695602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417ea9a-b368-44e9-9138-1a11fe3fea24 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:47.704421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 506/1000] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:47.710532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:47.813371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87542b1f-64dd-4876-8aa3-ebe87767f295 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:47.847158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353e1b4-0227-4b3b-862e-4846b047bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:47.847764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353e1b4-0227-4b3b-862e-4846b047bd8d None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:47.848042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353e1b4-0227-4b3b-862e-4846b047bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:47.848479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353e1b4-0227-4b3b-862e-4846b047bd8d None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:47.849116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353e1b4-0227-4b3b-862e-4846b047bd8d None admin] RBAC: Adding query filter params (type=image) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:47.849418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353e1b4-0227-4b3b-862e-4846b047bd8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:47.850795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353e1b4-0227-4b3b-862e-4846b047bd8d None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:47.858164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 495/1001] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:48.614886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d0d8-a998-4b57-a069-489adddf36c9 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:48.615445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d0d8-a998-4b57-a069-489adddf36c9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:48.615445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d0d8-a998-4b57-a069-489adddf36c9 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:48.617031 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 507/1002] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:48.622861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163dc3-4e1e-4373-b75c-5ecef14ec8aa None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:48.623280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163dc3-4e1e-4373-b75c-5ecef14ec8aa None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:48.623421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3163dc3-4e1e-4373-b75c-5ecef14ec8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:48.642864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d3163dc3-4e1e-4373-b75c-5ecef14ec8aa None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:48.644057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d3163dc3-4e1e-4373-b75c-5ecef14ec8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:48.651599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:48.720500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 496/1003] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:48.990274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d0d8-a998-4b57-a069-489adddf36c9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:49.010331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:49.094793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d0d8-a998-4b57-a069-489adddf36c9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:49.129020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d628d-044c-4527-9ced-4edd32aef54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:49.129652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d628d-044c-4527-9ced-4edd32aef54a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.129933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d628d-044c-4527-9ced-4edd32aef54a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.130236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d628d-044c-4527-9ced-4edd32aef54a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.130819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d628d-044c-4527-9ced-4edd32aef54a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:49.132190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d628d-044c-4527-9ced-4edd32aef54a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-121d628d-044c-4527-9ced-4edd32aef54a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:49.142017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:49.143136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 14:45:49.144510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:49.145574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 508/1004] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Sep 9 14:45:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:49.149009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163dc3-4e1e-4373-b75c-5ecef14ec8aa None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:49.253106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3163dc3-4e1e-4373-b75c-5ecef14ec8aa None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:49.287137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:49.287744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.288024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.288319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.288918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:49.289220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:49.290618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:49.294038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e3079-4802-4f26-a3c3-5ffdc3f37f07 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.294412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e3079-4802-4f26-a3c3-5ffdc3f37f07 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.294763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e3079-4802-4f26-a3c3-5ffdc3f37f07 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.296334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 509/1005] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:49.303239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 497/1006] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:49.303902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:49.304117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577dbfe-8d6a-4201-849d-1f8df8cf5621 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.304512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577dbfe-8d6a-4201-849d-1f8df8cf5621 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.304905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577dbfe-8d6a-4201-849d-1f8df8cf5621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.312418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:49.323906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5577dbfe-8d6a-4201-849d-1f8df8cf5621 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:49.325129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5577dbfe-8d6a-4201-849d-1f8df8cf5621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:49.395802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 510/1007] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:49.411685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775f640-caa7-47bf-b476-997a088d31cb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:49.447051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:49.447669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.447939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.448210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.448832 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:49.449137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:49.450586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:49.460980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 498/1008] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Sep 9 14:45:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:49.462336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577dbfe-8d6a-4201-849d-1f8df8cf5621 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:49.476925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:49.567160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577dbfe-8d6a-4201-849d-1f8df8cf5621 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:49.600838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:49.601452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.601732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.602005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.602701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:49.604066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:49.626133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 511/1009] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:49.668693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:49.753728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:49.788221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36f97d-0e63-4276-bc0f-b4e2d8361d02 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:49.830260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:49.831129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.831558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.832265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.832917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:49.834339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:49.843780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:49.844796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:49.846249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 499/1010] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:49.851012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:49.922756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:49.959211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b374fc-d8b4-4e80-872a-26b43efe276f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:49.994483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1ac5d-88e8-485a-a4ab-66cb14ccc09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:49.995087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ac5d-88e8-485a-a4ab-66cb14ccc09b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:49.995367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ac5d-88e8-485a-a4ab-66cb14ccc09b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:49.995628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ac5d-88e8-485a-a4ab-66cb14ccc09b None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:49.996277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1ac5d-88e8-485a-a4ab-66cb14ccc09b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:49.996575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1ac5d-88e8-485a-a4ab-66cb14ccc09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:49.998051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1ac5d-88e8-485a-a4ab-66cb14ccc09b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:50.003043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 512/1011] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:50.008426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:50.054759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb5ef-2a51-44a4-8807-549b1365bd0d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:50.055046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb5ef-2a51-44a4-8807-549b1365bd0d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:50.055331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb5ef-2a51-44a4-8807-549b1365bd0d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:50.056652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 513/1012] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:50.061659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c66d25-24fd-42df-b9e2-3122c9bf28e5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:50.061942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c66d25-24fd-42df-b9e2-3122c9bf28e5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:50.062244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c66d25-24fd-42df-b9e2-3122c9bf28e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:50.082498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f4c66d25-24fd-42df-b9e2-3122c9bf28e5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:50.083605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f4c66d25-24fd-42df-b9e2-3122c9bf28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:50.120697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c8d48-22bb-4672-b46f-c269fffa4b4a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:50.151509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:50.158870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:50.159475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:50.159750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:50.160016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:50.160630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:50.160933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:50.162304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:50.170119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 514/1013] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:50.171029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 500/1014] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Sep 9 14:45:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:50.175983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c66d25-24fd-42df-b9e2-3122c9bf28e5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:50.243515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:50.279269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c66d25-24fd-42df-b9e2-3122c9bf28e5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:50.314702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd989b-17e4-4eea-970d-66e3f9d78784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:50.315314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd989b-17e4-4eea-970d-66e3f9d78784 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:50.315594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd989b-17e4-4eea-970d-66e3f9d78784 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:50.315863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd989b-17e4-4eea-970d-66e3f9d78784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:50.316523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd989b-17e4-4eea-970d-66e3f9d78784 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:50.317893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd989b-17e4-4eea-970d-66e3f9d78784 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:50.346227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 515/1015] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:45:50.432947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:50.542648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b92806-a28e-4225-ad62-7ae6d58bf030 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:50.591588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98d344-6189-4e87-9759-5ac27c1e6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:50.592188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d344-6189-4e87-9759-5ac27c1e6681 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:50.592462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d344-6189-4e87-9759-5ac27c1e6681 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:50.592725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98d344-6189-4e87-9759-5ac27c1e6681 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:50.593359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98d344-6189-4e87-9759-5ac27c1e6681 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:50.594770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98d344-6189-4e87-9759-5ac27c1e6681 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:50.611687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 501/1016] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:50 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:51.837104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1592-fe8c-4476-a2f4-c58b56616edb None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:51.837636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1592-fe8c-4476-a2f4-c58b56616edb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:51.837636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1592-fe8c-4476-a2f4-c58b56616edb None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:51.839150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 516/1017] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:51.844236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7aa2-629e-4ad8-90c8-ca6574ab2a01 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:51.844620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7aa2-629e-4ad8-90c8-ca6574ab2a01 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:51.844782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7aa2-629e-4ad8-90c8-ca6574ab2a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:51.863451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-798c7aa2-629e-4ad8-90c8-ca6574ab2a01 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:51.864632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-798c7aa2-629e-4ad8-90c8-ca6574ab2a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:51.911924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:51.941975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 502/1018] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:52.210020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db1592-fe8c-4476-a2f4-c58b56616edb None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:52.316075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db1592-fe8c-4476-a2f4-c58b56616edb None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:52.339266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:52.353383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41144f-8e26-4054-a5f6-94c777c86091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:52.354020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41144f-8e26-4054-a5f6-94c777c86091 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:52.354325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41144f-8e26-4054-a5f6-94c777c86091 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:52.354603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41144f-8e26-4054-a5f6-94c777c86091 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:52.356287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41144f-8e26-4054-a5f6-94c777c86091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:52.357717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41144f-8e26-4054-a5f6-94c777c86091 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:52.359485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 517/1019] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:52.365035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c7aa2-629e-4ad8-90c8-ca6574ab2a01 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:52.465009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c7aa2-629e-4ad8-90c8-ca6574ab2a01 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:52.503658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706876b0-1d52-4c8e-a901-466a035b0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:52.504291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706876b0-1d52-4c8e-a901-466a035b0af4 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:52.504572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706876b0-1d52-4c8e-a901-466a035b0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:52.504846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706876b0-1d52-4c8e-a901-466a035b0af4 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:52.505514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706876b0-1d52-4c8e-a901-466a035b0af4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:52.507045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706876b0-1d52-4c8e-a901-466a035b0af4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:52.536886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 503/1020] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:45:52 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:45:52.609120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3de16-80de-4f2a-821a-66bebcc12bba None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:52.609466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3de16-80de-4f2a-821a-66bebcc12bba None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:52.609669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3de16-80de-4f2a-821a-66bebcc12bba None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:52.611215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 518/1021] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:52.616941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f4c6-ee0d-479b-ba35-9038a3c951b1 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:52.617231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f4c6-ee0d-479b-ba35-9038a3c951b1 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:52.617490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f4c6-ee0d-479b-ba35-9038a3c951b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:52.637989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7184f4c6-ee0d-479b-ba35-9038a3c951b1 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:52.639226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7184f4c6-ee0d-479b-ba35-9038a3c951b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:52.667204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:52.738294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 504/1022] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:52.796939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286187-1a05-49d6-9c1d-209e1056ca39 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:52.797223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286187-1a05-49d6-9c1d-209e1056ca39 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:52.797497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286187-1a05-49d6-9c1d-209e1056ca39 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:52.798991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 519/1023] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:52.804066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcebd13-8598-4626-8aaf-07bde9841ca3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:52.804350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcebd13-8598-4626-8aaf-07bde9841ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:52.804619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcebd13-8598-4626-8aaf-07bde9841ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:52.823422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1fcebd13-8598-4626-8aaf-07bde9841ca3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:52.825516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1fcebd13-8598-4626-8aaf-07bde9841ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:52.898124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 505/1024] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:52.998627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24286187-1a05-49d6-9c1d-209e1056ca39 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.104713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24286187-1a05-49d6-9c1d-209e1056ca39 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.138960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.139593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.139874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.140146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.151500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:53.156439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:53.157362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:53.158241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 520/1025] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Sep 9 14:45:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:53.163626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcebd13-8598-4626-8aaf-07bde9841ca3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.176867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.232638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.254209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.266429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcebd13-8598-4626-8aaf-07bde9841ca3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.290029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5af89c-24e1-41fb-8266-91f6e0c5928a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.306568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.307182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.307459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.307728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.308497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:53.308744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.310123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.318782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 506/1026] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:53.325008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.333243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.333872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.334173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.334442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.335018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.336375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:53.345922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:53.347112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:53.347947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 521/1027] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:53.352839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.432540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d3fd3-041d-4471-88ce-c8112d90a330 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.459702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7405d8-4033-4c22-8944-f7f591227dd3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.468512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.469258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.469539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.469808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.476877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.482848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.484310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:53.500324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:53.501521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:53.502629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:53.502629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:53.502629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:53.502845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.502845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.502845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.502845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.503165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] RBAC: Adding query filter params (name=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:53.503165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.504417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.504938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 507/1028] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:53.510246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.514134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 522/1029] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:53.514289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.518184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.621619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc352d-4d43-428f-878d-579363a5aca0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.626839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a862f9-18e1-4563-b9f5-8e561b3eaa5a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.657351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.657946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.658257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.658515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.659147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:53.659445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.660785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.662153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.662751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.663026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.663297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.663917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] RBAC: Adding query filter params (type=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:53.664215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.665542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.670645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 523/1030] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:53.673499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 508/1031] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:53.676294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.680537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.724224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.747698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.783845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80addc94-a5d9-4b01-abf1-f6114a8bcf88 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.787640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a84c3-4f2f-4086-8af1-0ec8137d574b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.818263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.818877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.819154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.819429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.820123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] RBAC: Adding query filter params (interface=public, service_id=eeb2cbaca8a04d568318415483d40817, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:53.820430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.821791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.825297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.825929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.826238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.826512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.832814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 524/1032] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/endpoints?service_id=eeb2cbaca8a04d568318415483d40817&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:53.833850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.834206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.835649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:53.848485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:53.849642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:53.850786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 509/1033] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:53.859130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:53.945179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c97c94-ca5e-412e-a0ae-42b861299c17 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.954278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.964599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee735-d3fb-4b20-bd58-6068c0b9bfaa None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:53.984746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:53.985460 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:53.985811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:53.986195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:53.986865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:53.988236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:53.989492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:53.995089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 525/1034] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:45:54.014760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:54.015395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:54.015672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:54.015942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:54.016704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:54.017010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:54.018574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:54.038786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 510/1035] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:45:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:54.045166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:54.154971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19c161-da65-4d33-aca4-fe7331b19e40 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:54.193415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:54.194024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:54.194328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:54.194597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:54.235518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:54.266172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:54.267920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:54.367194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 526/1036] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 14:45:54.373644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:54.472994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52a551-3233-447a-8c78-c5d938dcc76b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:54.509046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:54.509996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:54.510441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:54.510870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:54.521138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:54.522760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:54.537817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:54.538952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:54.540054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:54.540054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:54.540054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:54.541741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 511/1037] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:54.547835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:54.618124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:54.649800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183bac81-c50c-4cc9-8a73-05b01669db12 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:54.692025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0ad3-445d-493d-9ce0-43ac1830c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:54.692645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0ad3-445d-493d-9ce0-43ac1830c1ae None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:54.692917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0ad3-445d-493d-9ce0-43ac1830c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:54.693186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0ad3-445d-493d-9ce0-43ac1830c1ae None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:54.693823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0ad3-445d-493d-9ce0-43ac1830c1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:54.694143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0ad3-445d-493d-9ce0-43ac1830c1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:54.695501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0ad3-445d-493d-9ce0-43ac1830c1ae None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:54.712723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 527/1038] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:54.714008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:54.747784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:54.775575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a424d-9004-4019-86e3-81f8d709a3d3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:54.775776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a424d-9004-4019-86e3-81f8d709a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:54.776019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a424d-9004-4019-86e3-81f8d709a3d3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:54.781700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 528/1039] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:54.783475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bc27-0521-47e1-ae7b-43419982eb4c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:54.783911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bc27-0521-47e1-ae7b-43419982eb4c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:54.784182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bc27-0521-47e1-ae7b-43419982eb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:54.802482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d845bc27-0521-47e1-ae7b-43419982eb4c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:54.803657 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d845bc27-0521-47e1-ae7b-43419982eb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:54.823668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f7952-20a0-4bf7-b0f4-ed5ef83a1a68 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:54.859741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:54.860722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:54.861104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:54.861388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:54.868720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:54.870105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:54.874505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 529/1040] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:54.881666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:54.882810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:54.883746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:54.888498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 512/1041] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:54.889493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845bc27-0521-47e1-ae7b-43419982eb4c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:54.952577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:54.993821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845bc27-0521-47e1-ae7b-43419982eb4c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:55.028493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:55.029096 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:55.029370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:55.029636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:55.030345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:55.030648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:55.032065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:55.049020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 530/1042] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:55.050127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:55.144291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:55.150794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:55.155254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bff2bb-0cae-4550-92a3-f513a7b63cd8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:55.190209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:55.190814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:55.191094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:55.191365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:55.192089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] RBAC: Adding query filter params (role.id=1d0742c5336d482ca12f0d59a0223e60, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=8908c33eb701459298d35fa8ccb80bd2) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:55.192396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:55.193821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:55.199788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 513/1043] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:55 2022] GET /identity/v3/role_assignments?user.id=8908c33eb701459298d35fa8ccb80bd2&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=1d0742c5336d482ca12f0d59a0223e60 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:55.269194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282be9-150d-43cc-a236-863c8ab54bbf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:55.291711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:55.309025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e842f1b-aca8-4ce1-aa19-d818231ef940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:55.309763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842f1b-aca8-4ce1-aa19-d818231ef940 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:55.310036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842f1b-aca8-4ce1-aa19-d818231ef940 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:55.310331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842f1b-aca8-4ce1-aa19-d818231ef940 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:55.311482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e842f1b-aca8-4ce1-aa19-d818231ef940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:55.312954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e842f1b-aca8-4ce1-aa19-d818231ef940 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:55.314756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 531/1044] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:55.320243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:55.433064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc657da-32b8-437d-85c4-80150104624b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:55.467644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f184-a311-4920-87a9-2343a4e14ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:55.468300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f184-a311-4920-87a9-2343a4e14ca5 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:55.468575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f184-a311-4920-87a9-2343a4e14ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:55.468838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f184-a311-4920-87a9-2343a4e14ca5 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:55.469537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f184-a311-4920-87a9-2343a4e14ca5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:55.470979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f184-a311-4920-87a9-2343a4e14ca5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:55.492526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 514/1045] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:45:55 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:45:56.186745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2c9a-d3f6-4f33-883e-686f1b6375b3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:56.187284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2c9a-d3f6-4f33-883e-686f1b6375b3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:56.187284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e2c9a-d3f6-4f33-883e-686f1b6375b3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:56.188807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 532/1046] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:56.193743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283228-c9a5-4cff-bbb3-e4a2fef3f988 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:56.194243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283228-c9a5-4cff-bbb3-e4a2fef3f988 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:56.194333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b283228-c9a5-4cff-bbb3-e4a2fef3f988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:56.213584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2b283228-c9a5-4cff-bbb3-e4a2fef3f988 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:56.215351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2b283228-c9a5-4cff-bbb3-e4a2fef3f988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:56.223268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:56.285925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 515/1047] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:56.555290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e2c9a-d3f6-4f33-883e-686f1b6375b3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:56.657487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e2c9a-d3f6-4f33-883e-686f1b6375b3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:56.702412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:56.703050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:56.703327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:56.703599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:56.704183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:56.705539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:56.715238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:56.716343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:56.717228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 533/1048] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Sep 9 14:45:56 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:56.722311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283228-c9a5-4cff-bbb3-e4a2fef3f988 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:56.825856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b283228-c9a5-4cff-bbb3-e4a2fef3f988 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:56.860721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:56.861330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:56.861607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:56.861883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:56.862545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:56.862849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:56.864205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:56.873696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 516/1049] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:56.875344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:56.931289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:56.982725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb5433-c15b-4c38-9d83-3d97741c2fc8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:57.018482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fdead6-ad39-449e-9484-f5fb1f07090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:57.019087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdead6-ad39-449e-9484-f5fb1f07090e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:57.019364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdead6-ad39-449e-9484-f5fb1f07090e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:57.019633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fdead6-ad39-449e-9484-f5fb1f07090e None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:57.020252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdead6-ad39-449e-9484-f5fb1f07090e None admin] RBAC: Adding query filter params (type=image) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:57.020550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdead6-ad39-449e-9484-f5fb1f07090e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:57.021906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fdead6-ad39-449e-9484-f5fb1f07090e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:57.032103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 534/1050] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:57.033629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:57.043128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:57.137118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7170a32-bdfe-45ff-96af-3f6bc2d85fb0 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:57.170562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59790ded-5eb5-40e9-b357-f3cf11aa20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:57.171246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59790ded-5eb5-40e9-b357-f3cf11aa20b2 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:57.171531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59790ded-5eb5-40e9-b357-f3cf11aa20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:57.171803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59790ded-5eb5-40e9-b357-f3cf11aa20b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:57.172469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59790ded-5eb5-40e9-b357-f3cf11aa20b2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:57.173829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59790ded-5eb5-40e9-b357-f3cf11aa20b2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:57.193444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 517/1051] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:45:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:45:57.356237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb32042-dd80-4a1c-b8bb-694f0bba9e52 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:57.356796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb32042-dd80-4a1c-b8bb-694f0bba9e52 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:57.356796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb32042-dd80-4a1c-b8bb-694f0bba9e52 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:57.358272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 535/1052] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:45:57.363505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f135-f452-4a4d-93ba-bc8c8622e9f0 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:57.363948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f135-f452-4a4d-93ba-bc8c8622e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:57.364049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f135-f452-4a4d-93ba-bc8c8622e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:57.383245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a1b0f135-f452-4a4d-93ba-bc8c8622e9f0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:57.384419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a1b0f135-f452-4a4d-93ba-bc8c8622e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:57.443995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:57.463909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 518/1053] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:45:57.736236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb32042-dd80-4a1c-b8bb-694f0bba9e52 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:57.746224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab03883-998d-428b-b502-c2bc0f6c064f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:57.746507 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab03883-998d-428b-b502-c2bc0f6c064f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:57.746776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab03883-998d-428b-b502-c2bc0f6c064f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:57.748252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 519/1054] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:57.753654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15951414-8b12-4104-bfef-c4a6f53138f0 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:57.753942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15951414-8b12-4104-bfef-c4a6f53138f0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:57.754263 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15951414-8b12-4104-bfef-c4a6f53138f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:57.773141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-15951414-8b12-4104-bfef-c4a6f53138f0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:57.774335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-15951414-8b12-4104-bfef-c4a6f53138f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:57.842683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 520/1055] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:57.849848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb32042-dd80-4a1c-b8bb-694f0bba9e52 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:57.866756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:57.884920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:57.885546 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:57.885824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:57.886106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:57.897007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:57.901727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:57.903472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:57.904295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 536/1056] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Sep 9 14:45:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:57.909589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15951414-8b12-4104-bfef-c4a6f53138f0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.011315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15951414-8b12-4104-bfef-c4a6f53138f0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.029001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:58.048068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.048674 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.048952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.049221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.049877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:58.050208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.051559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.059884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 521/1057] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Sep 9 14:45:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:58.065527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.122203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.172615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c412-90f7-46c5-8d40-03c9f93c6b26 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.212705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.213325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.213596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.213863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.225641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.227115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.228151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0299-410f-4d3f-9480-220738eba442 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:58.244128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:58.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:58.246915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:58.246915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:58.246915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:58.246915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 537/1058] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:45:58.250871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.266067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.266653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.266929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.267194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.280514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:58.280643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:45:58.285856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:58.286812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:45:58.287799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 522/1059] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:58.293442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.336431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:58.360502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9975eb8-cfe1-42fd-a0e2-e058eefd86db None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.395800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.396401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.396676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.396945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.397575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:58.397876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.399266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.403155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319031b-ea99-45e2-a61f-cc4eab9898f8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.411726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 538/1060] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:58.417113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.442695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.443643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.444217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.444495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.445153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:58.445457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.447107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.458550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 523/1061] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:58.464687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.508057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:58.521325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c215-f1c0-4144-8c8c-4ec97647e091 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.558693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.559648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.559929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.560199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.567425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.568853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.569842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbb658-b2e2-499e-83a2-825a3c8f79b1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.571561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:45:58.582190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:58.583171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:58.584127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 539/1062] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:58.589052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.613743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.614430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.614704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.614972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] PATH_INFO: `/v3/users/ebf2ed4f22c24951bdc89d11885b4e27` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.628836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf2ed4f22c24951bdc89d11885b4e27)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.630337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.632198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 524/1063] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/users/ebf2ed4f22c24951bdc89d11885b4e27 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:58.638708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.702458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41271f3-a18a-4d97-93c9-b2aba7e24a48 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.739759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.740370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.740651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.740814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681d9f1-537f-47b4-b502-16df5a942576 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.740915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.741641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:58.741946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.743429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.760837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 540/1064] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:58.766647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.775045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:58.775995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.776680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.777738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.778258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.808871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:58.852046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.853487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.872539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a86f4b-ac9c-4d5c-9014-93032ec6bda0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:58.908228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:58.908864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:58.909144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:58.909417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:58.921217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:58.922791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:45:58.937707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:58.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:45:58.940584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:45:58.940584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:45:58.940584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:58.940584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 541/1065] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:58.944254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:58.970955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 525/1066] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 14:45:58.971750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:59.006686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:59.036026 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:59.056919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed50f79-c0c7-438b-99b5-7c83e9cbf19d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:59.082430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9811a-aec0-46d9-b874-eb57cbeabce2 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:59.092034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:59.092800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.093078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.093345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.093986 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:59.094340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:59.095688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:59.108228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 542/1067] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:59.113302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:59.124891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:59.125607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.125889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.126267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.127427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] RBAC: Authorizing `identity:get_project(project_id=92087e4c892d4a718628b5b3eacb01b4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:59.128851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:59.130747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 526/1068] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:45:58 2022] GET /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:59.137118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:59.226341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f556cd3-e1ac-4376-8f2c-93f63b42f74c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:59.248385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d6ccc-a560-4709-a214-c13685e87407 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:59.248889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:59.267568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:59.268201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.268477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.268749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.275737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:59.278006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:59.278623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:59.288590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d407d-58a8-4c3c-b4c3-91e9da0435e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:59.289125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d407d-58a8-4c3c-b4c3-91e9da0435e4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.289404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d407d-58a8-4c3c-b4c3-91e9da0435e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.289679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d407d-58a8-4c3c-b4c3-91e9da0435e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:45:59.290227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:45:59.291107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:45:59.292049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:45:59.292529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d407d-58a8-4c3c-b4c3-91e9da0435e4 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=92087e4c892d4a718628b5b3eacb01b4, user.id=ebf2ed4f22c24951bdc89d11885b4e27) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:59.292529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d407d-58a8-4c3c-b4c3-91e9da0435e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:59.292711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 543/1069] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:45:59.292788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d407d-58a8-4c3c-b4c3-91e9da0435e4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:59.306624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 527/1070] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:45:59 2022] GET /identity/v3/role_assignments?user.id=ebf2ed4f22c24951bdc89d11885b4e27&scope.project.id=92087e4c892d4a718628b5b3eacb01b4&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:45:59.306861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:59.413097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d57ba-98ad-4564-80c4-7099718a0259 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.413619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d57ba-98ad-4564-80c4-7099718a0259 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.413619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d57ba-98ad-4564-80c4-7099718a0259 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.415014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 528/1071] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:45:59.415603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9a10-96c3-453b-86f4-249daa3e19c3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:59.421206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36963a-9520-4d48-b059-c2d71eae6d00 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.421491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36963a-9520-4d48-b059-c2d71eae6d00 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.421750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36963a-9520-4d48-b059-c2d71eae6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.440680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-5e36963a-9520-4d48-b059-c2d71eae6d00 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:45:59.441903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5e36963a-9520-4d48-b059-c2d71eae6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:45:59.452136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:59.452746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.453022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.453292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.453988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:45:59.454321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:59.455759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:59.469153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 544/1072] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:45:59.475052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:59.520862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:59.526173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 529/1073] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:45:59.588171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd453-aa79-43e6-9d78-ec74b015301a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:59.624300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:59.624962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.625242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.625518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/8908c33eb701459298d35fa8ccb80bd2/roles/1d0742c5336d482ca12f0d59a0223e60` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:45:59.627740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=8908c33eb701459298d35fa8ccb80bd2, role_id=1d0742c5336d482ca12f0d59a0223e60)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:45:59.629180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:45:59.642505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 545/1074] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:45:59 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/8908c33eb701459298d35fa8ccb80bd2/roles/1d0742c5336d482ca12f0d59a0223e60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:45:59.803254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36963a-9520-4d48-b059-c2d71eae6d00 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:45:59.906575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36963a-9520-4d48-b059-c2d71eae6d00 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:45:59.929661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:45:59.942294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:45:59.942902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:45:59.943180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:45:59.943451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:00.011007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:00.013306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:00.114141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 530/1075] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:45:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:00.119139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:00.220524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:00.225398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efbe9d-6a7e-42fd-8c0b-84d5e2f50faf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:00.262983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63953e56-8478-4abc-af2d-305bed4ffb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:00.263605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953e56-8478-4abc-af2d-305bed4ffb47 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:00.263885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953e56-8478-4abc-af2d-305bed4ffb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:00.264157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953e56-8478-4abc-af2d-305bed4ffb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:00.274187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63953e56-8478-4abc-af2d-305bed4ffb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:00.275623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63953e56-8478-4abc-af2d-305bed4ffb47 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-63953e56-8478-4abc-af2d-305bed4ffb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:46:00.290606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:00.291548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:46:00.292480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:46:00.292480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:46:00.292480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:46:00.292480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 546/1076] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:00.298276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:00.321920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:00.398968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c260e1-d19f-441d-ac0e-775951aa3abf None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:00.432924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657fc5e-3c98-4087-ab24-f5949076c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:00.434256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fc5e-3c98-4087-ab24-f5949076c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:00.434452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fc5e-3c98-4087-ab24-f5949076c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:00.434723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657fc5e-3c98-4087-ab24-f5949076c4f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:00.435360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657fc5e-3c98-4087-ab24-f5949076c4f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:00.435662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657fc5e-3c98-4087-ab24-f5949076c4f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:00.437014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657fc5e-3c98-4087-ab24-f5949076c4f0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:00.454359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 531/1077] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:01.484308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9ce3-5a15-4152-9be1-b459ecfe1be6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:01.486451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9ce3-5a15-4152-9be1-b459ecfe1be6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:01.486451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab9ce3-5a15-4152-9be1-b459ecfe1be6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:01.486451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 547/1078] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:01.491529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79452-b6e4-4c17-9152-9bec9037a5d1 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:01.491969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79452-b6e4-4c17-9152-9bec9037a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:01.492199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa79452-b6e4-4c17-9152-9bec9037a5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:01.510378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8fa79452-b6e4-4c17-9152-9bec9037a5d1 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:01.512121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8fa79452-b6e4-4c17-9152-9bec9037a5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:01.583798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 532/1079] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:01.829705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efdccb-b227-4913-b81b-57116389c09a None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:01.829989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efdccb-b227-4913-b81b-57116389c09a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:01.830204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efdccb-b227-4913-b81b-57116389c09a None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:01.831916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 548/1080] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:01.836853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0e31-175e-4dcc-b8e7-5a5a85a16877 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:01.837197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0e31-175e-4dcc-b8e7-5a5a85a16877 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:01.837532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0e31-175e-4dcc-b8e7-5a5a85a16877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:01.852957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efdccb-b227-4913-b81b-57116389c09a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:01.856367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-48eb0e31-175e-4dcc-b8e7-5a5a85a16877 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:01.857563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-48eb0e31-175e-4dcc-b8e7-5a5a85a16877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:01.864918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:01.925059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 533/1081] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:01.954635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efdccb-b227-4913-b81b-57116389c09a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:01.988385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:01.989038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:01.989317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:01.989590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.000057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:02.004810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:02.005849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:46:02.006813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 549/1082] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:46:02.012220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0e31-175e-4dcc-b8e7-5a5a85a16877 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.109642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb0e31-175e-4dcc-b8e7-5a5a85a16877 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.142449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.143044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.143324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.143596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.144252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:02.144554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.145899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:02.154316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 534/1083] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:02.160145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.172768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:02.192352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.196038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:02.260969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34472c8-92fa-4c23-bae0-5d4bc622eba4 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.292478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f08238-072d-4dda-9a30-8a56d7d7d2b7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.295177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.295796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.296072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.296342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] PATH_INFO: `/v3/users/ebf2ed4f22c24951bdc89d11885b4e27` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.297461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf2ed4f22c24951bdc89d11885b4e27)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.298915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:02.300476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 550/1084] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/users/ebf2ed4f22c24951bdc89d11885b4e27 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:02.306189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.333603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.334609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.335068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.335512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.347972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:02.352661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:02.353766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:02.354676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 535/1085] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:46:02.359837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.393871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:02.415854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d62b4-3dd4-486a-975e-d7cf181be3a2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.420997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:02.448136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.449504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.449632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.449805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.450941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] RBAC: Authorizing `identity:get_project(project_id=92087e4c892d4a718628b5b3eacb01b4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.452356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:02.453952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 551/1086] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:46:02.458697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d9f8-03be-4b1c-8a50-479d3f9d96e7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.460029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.492119 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.492721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.492997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.493265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.493910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:02.494243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.496138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:02.503936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 536/1087] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:46:02.509598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.563402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a765be7-0cfd-48c5-aae7-ad1118e21e91 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.597993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.599304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.599586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.599852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4/users/ebf2ed4f22c24951bdc89d11885b4e27/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.601768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] RBAC: Authorizing `identity:create_grant(project_id=92087e4c892d4a718628b5b3eacb01b4, user_id=ebf2ed4f22c24951bdc89d11885b4e27, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.603211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:02.607188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beecf78-906b-48a0-8d3c-a60100bed010 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.616629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 552/1088] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:46:02 2022] PUT /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4/users/ebf2ed4f22c24951bdc89d11885b4e27/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:46:02.635641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:02.646359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.647015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.647306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.647554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.659524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.660975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:46:02.676421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:02.677679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:46:02.678927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:46:02.678927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:46:02.678927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:02.678927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 537/1089] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:46:02.684448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.694404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:02.800014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef9cc-89cf-4d02-97b7-1e1fbb12ad53 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.834712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.835315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.835588 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.835853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.836481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:02.836780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.838155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:02.849898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 553/1090] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:02.855735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:02.954190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d049d2-da20-4788-a8e8-394ff4d33884 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:02.988180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:02.988806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:02.989084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:02.989355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:02.997348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:02.998810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:46:03.009532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:03.010593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:03.011850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 538/1091] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Sep 9 14:46:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:03.016429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:03.083949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:03.120062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a5350-e6c7-4fe1-8824-d4210c3f8c6f None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:03.154268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:03.154860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:03.155133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:03.155405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:03.156113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:03.156411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:03.157807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:03.175342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 554/1092] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Sep 9 14:46:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:03.181086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:03.220177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:03.281259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4708f6a-a533-4051-bd9f-a94060633617 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:03.317496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:03.318117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:03.318401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:03.318670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:03.384639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:03.386162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:03.423745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:03.483907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 539/1093] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:03.489839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:03.594356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebab6d-8004-4ef0-a8a8-eaa81b58d599 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:03.616731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:03.628207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:03.628826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:03.629104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:03.629373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:03.639740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:03.641169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:46:03.655221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:03.656369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:46:03.657274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:46:03.657274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:46:03.657274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:46:03.657274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 555/1094] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:03.661931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:03.764421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e342ee-7c81-4b80-9524-62f9ed02900a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:03.797735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:03.798370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:03.798652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:03.798922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:03.799552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:03.799854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:03.801205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:03.807551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:03.814296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 540/1095] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:46:03.820039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:03.918705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c2cf0-7fd8-4434-8814-e9a0eae943f1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:03.951476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:03.952090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:03.952365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:03.952633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:03.959334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:03.960756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:46:03.971686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:03.972589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:46:03.973491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 556/1096] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:03.978557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:04.076203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463d0f8-caae-4452-9e3a-93ca27f42388 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:04.109481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e3ee3-196b-4de1-b003-116bd5d2e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:04.110100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3ee3-196b-4de1-b003-116bd5d2e113 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:04.110387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3ee3-196b-4de1-b003-116bd5d2e113 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:04.110661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e3ee3-196b-4de1-b003-116bd5d2e113 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:04.111340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e3ee3-196b-4de1-b003-116bd5d2e113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:04.111643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e3ee3-196b-4de1-b003-116bd5d2e113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:04.113060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e3ee3-196b-4de1-b003-116bd5d2e113 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:04.124768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 541/1097] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:04.130814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:04.165399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:04.230509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b282-d11a-4aa2-9a1e-073589a489f0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:04.263817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1450982-956e-4d7d-97dc-054fe286718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:04.264416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450982-956e-4d7d-97dc-054fe286718b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:04.264697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450982-956e-4d7d-97dc-054fe286718b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:04.264973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1450982-956e-4d7d-97dc-054fe286718b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:04.265691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450982-956e-4d7d-97dc-054fe286718b None admin] RBAC: Adding query filter params (role.id=1d0742c5336d482ca12f0d59a0223e60, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=8908c33eb701459298d35fa8ccb80bd2) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:04.265997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450982-956e-4d7d-97dc-054fe286718b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:04.267440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1450982-956e-4d7d-97dc-054fe286718b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:04.273144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 557/1098] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:04 2022] GET /identity/v3/role_assignments?user.id=8908c33eb701459298d35fa8ccb80bd2&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=1d0742c5336d482ca12f0d59a0223e60 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:46:04.773830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26879397-79c1-4ab2-8370-10818eab0b04 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:04.774390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26879397-79c1-4ab2-8370-10818eab0b04 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:04.774390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26879397-79c1-4ab2-8370-10818eab0b04 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:04.775738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 542/1099] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:04.781490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1653be-e90d-4f1f-a17e-8ad7f694188e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:04.781924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1653be-e90d-4f1f-a17e-8ad7f694188e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:04.782051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1653be-e90d-4f1f-a17e-8ad7f694188e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:04.800332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ae1653be-e90d-4f1f-a17e-8ad7f694188e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:04.801529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ae1653be-e90d-4f1f-a17e-8ad7f694188e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:04.869918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 558/1100] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:05.141660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26879397-79c1-4ab2-8370-10818eab0b04 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:05.200006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:05.241312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26879397-79c1-4ab2-8370-10818eab0b04 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:05.274509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:05.275081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:05.275356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:05.275620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:05.285513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:05.290208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:05.291365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:05.292997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 543/1101] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:05.297798 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1653be-e90d-4f1f-a17e-8ad7f694188e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:05.327356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:05.394634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1653be-e90d-4f1f-a17e-8ad7f694188e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:05.427219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:05.427803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:05.428078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:05.428347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:05.428994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:05.429289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:05.430739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:05.439043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 559/1102] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:05.444898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:05.541759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f612a-dd0e-4bbd-b616-d4f047ba15e4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:05.558723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:05.575731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:05.576354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:05.576632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:05.576904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] PATH_INFO: `/v3/users/ebf2ed4f22c24951bdc89d11885b4e27` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:05.578045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] RBAC: Authorizing `identity:get_user(user_id=ebf2ed4f22c24951bdc89d11885b4e27)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:05.579500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:05.581079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 544/1103] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:05 2022] GET /identity/v3/users/ebf2ed4f22c24951bdc89d11885b4e27 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:05.587119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:05.676569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:05.685500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818251e3-85d5-491b-9706-86a86398be57 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:05.719353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:05.719955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:05.720236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:05.720508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:05.785757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:05.787229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:05.874038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:05.883571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 560/1104] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:05.890230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:05.987677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ecc51-96ba-4d77-91fb-79adc05d2460 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:06.020594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890f1b7-7a18-4231-8e23-afddc30777fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:06.021211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f1b7-7a18-4231-8e23-afddc30777fe None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:06.021490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f1b7-7a18-4231-8e23-afddc30777fe None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:06.021761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890f1b7-7a18-4231-8e23-afddc30777fe None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:06.022892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f1b7-7a18-4231-8e23-afddc30777fe None admin] RBAC: Authorizing `identity:get_project(project_id=92087e4c892d4a718628b5b3eacb01b4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:06.024303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890f1b7-7a18-4231-8e23-afddc30777fe None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:06.025900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 545/1105] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:05 2022] GET /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:06.032529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:06.128676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbc436-cebb-4af8-b204-165efca48116 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:06.162197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d71a7-b07c-47fd-9958-6b09e95abd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:06.162803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d71a7-b07c-47fd-9958-6b09e95abd88 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:06.163087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d71a7-b07c-47fd-9958-6b09e95abd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:06.163357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d71a7-b07c-47fd-9958-6b09e95abd88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:06.164074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d71a7-b07c-47fd-9958-6b09e95abd88 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=92087e4c892d4a718628b5b3eacb01b4, user.id=ebf2ed4f22c24951bdc89d11885b4e27) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:06.164380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d71a7-b07c-47fd-9958-6b09e95abd88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:06.165797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d71a7-b07c-47fd-9958-6b09e95abd88 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:06.172110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 561/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:06 2022] GET /identity/v3/role_assignments?user.id=ebf2ed4f22c24951bdc89d11885b4e27&scope.project.id=92087e4c892d4a718628b5b3eacb01b4&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:08.336703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8195d-1506-46e8-b2b3-574c9ea4fb2f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:08.337239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8195d-1506-46e8-b2b3-574c9ea4fb2f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:08.337239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8195d-1506-46e8-b2b3-574c9ea4fb2f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:08.338608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 546/1107] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:08.343976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7b8f-46e1-46f3-817f-850e70fb9a57 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:08.344412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7b8f-46e1-46f3-817f-850e70fb9a57 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:08.344529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a7b8f-46e1-46f3-817f-850e70fb9a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:08.363581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4e4a7b8f-46e1-46f3-817f-850e70fb9a57 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:08.364754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4e4a7b8f-46e1-46f3-817f-850e70fb9a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:08.413246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:08.429988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 562/1108] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:08.702675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8195d-1506-46e8-b2b3-574c9ea4fb2f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:08.757788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:08.804089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8195d-1506-46e8-b2b3-574c9ea4fb2f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:08.836045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05273fdc-1110-44e8-9de9-dd8c96ed4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:08.836648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273fdc-1110-44e8-9de9-dd8c96ed4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:08.836921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273fdc-1110-44e8-9de9-dd8c96ed4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:08.837191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273fdc-1110-44e8-9de9-dd8c96ed4f9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:08.838301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05273fdc-1110-44e8-9de9-dd8c96ed4f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:08.840269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05273fdc-1110-44e8-9de9-dd8c96ed4f9a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:08.841805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 547/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:46:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:08.847489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a7b8f-46e1-46f3-817f-850e70fb9a57 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:08.941876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a7b8f-46e1-46f3-817f-850e70fb9a57 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:08.975294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a212100-3e10-476b-a866-35f818de67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:08.975822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a212100-3e10-476b-a866-35f818de67ba None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:08.976098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a212100-3e10-476b-a866-35f818de67ba None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:08.976363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a212100-3e10-476b-a866-35f818de67ba None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:08.976991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a212100-3e10-476b-a866-35f818de67ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:08.978419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a212100-3e10-476b-a866-35f818de67ba None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:08.999221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 563/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:46:08 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:46:11.146105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ab82-1488-46a8-b245-2c7844ebf387 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:11.146638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ab82-1488-46a8-b245-2c7844ebf387 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:11.146782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ab82-1488-46a8-b245-2c7844ebf387 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:11.148122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 548/1111] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:11.153906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb985cc-1ef9-4343-b5b3-a325db591b53 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:11.154358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb985cc-1ef9-4343-b5b3-a325db591b53 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:11.154458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb985cc-1ef9-4343-b5b3-a325db591b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:11.172239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5fb985cc-1ef9-4343-b5b3-a325db591b53 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:11.173414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5fb985cc-1ef9-4343-b5b3-a325db591b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:11.208143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:11.239856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 564/1112] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:11.508847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ab82-1488-46a8-b245-2c7844ebf387 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:11.607013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ab82-1488-46a8-b245-2c7844ebf387 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:11.628323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:11.639658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:11.640269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:11.640542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:11.640806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] PATH_INFO: `/v3/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:11.642184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] RBAC: Authorizing `identity:get_role(role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:11.643525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:11.644822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 549/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:11 2022] GET /identity/v3/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:11.650623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb985cc-1ef9-4343-b5b3-a325db591b53 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:11.748620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb985cc-1ef9-4343-b5b3-a325db591b53 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:11.781907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:11.782496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:11.782807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:11.783083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] PATH_INFO: `/v3/users/a3689df36c15478f84beee66bac66e99` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:11.796256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] RBAC: Authorizing `identity:get_user(user_id=a3689df36c15478f84beee66bac66e99)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:11.797693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:11.799311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 565/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:11 2022] GET /identity/v3/users/a3689df36c15478f84beee66bac66e99 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:11.805037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:11.902418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab825196-a755-4913-b691-25c7d3a36607 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:11.935105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:11.935701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:11.935980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:11.936251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:11.991440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:12.001805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:12.003277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:12.098504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 550/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:12.104387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:12.133718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:12.202240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039772d8-8387-4102-8b55-c394959bffa6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:12.235757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00389857-294e-4e84-bfda-2b6082201d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:12.236365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389857-294e-4e84-bfda-2b6082201d8c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:12.236640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389857-294e-4e84-bfda-2b6082201d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:12.236908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00389857-294e-4e84-bfda-2b6082201d8c None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:12.237995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389857-294e-4e84-bfda-2b6082201d8c None admin] RBAC: Authorizing `identity:get_project(project_id=92087e4c892d4a718628b5b3eacb01b4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:12.239434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00389857-294e-4e84-bfda-2b6082201d8c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:12.241022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 566/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:12 2022] GET /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:12.247714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:12.335277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:12.345327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34e0ea-14ec-4fb6-8158-91c25f1ad7a7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:12.377914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793a045-33d1-4ea1-94cd-abefed3ed781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:12.378467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793a045-33d1-4ea1-94cd-abefed3ed781 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:12.378744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793a045-33d1-4ea1-94cd-abefed3ed781 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:12.379012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793a045-33d1-4ea1-94cd-abefed3ed781 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:12.379720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793a045-33d1-4ea1-94cd-abefed3ed781 None admin] RBAC: Adding query filter params (role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=92087e4c892d4a718628b5b3eacb01b4, user.id=a3689df36c15478f84beee66bac66e99) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:12.380024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793a045-33d1-4ea1-94cd-abefed3ed781 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:12.381420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793a045-33d1-4ea1-94cd-abefed3ed781 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:12.387141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 551/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:12 2022] GET /identity/v3/role_assignments?user.id=a3689df36c15478f84beee66bac66e99&scope.project.id=92087e4c892d4a718628b5b3eacb01b4&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:14.501787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f7811-0b07-4fb5-9ccb-efcfd204b49b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:14.502345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f7811-0b07-4fb5-9ccb-efcfd204b49b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:14.502345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f7811-0b07-4fb5-9ccb-efcfd204b49b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:14.503683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 567/1118] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:14.508928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8237a-0f0b-4059-8668-15126f92d441 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:14.509360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8237a-0f0b-4059-8668-15126f92d441 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:14.509452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8237a-0f0b-4059-8668-15126f92d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:14.527717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0aa8237a-0f0b-4059-8668-15126f92d441 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:14.528871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0aa8237a-0f0b-4059-8668-15126f92d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:14.592412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 552/1119] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:14.861688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f7811-0b07-4fb5-9ccb-efcfd204b49b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:14.957187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:14.962309 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f7811-0b07-4fb5-9ccb-efcfd204b49b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:14.996923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:14.997538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:14.997817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:14.998117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] PATH_INFO: `/v3/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:14.999488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] RBAC: Authorizing `identity:get_role(role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:15.000854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:15.002165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 568/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:14 2022] GET /identity/v3/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:15.007951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8237a-0f0b-4059-8668-15126f92d441 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:15.088417 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:15.104552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8237a-0f0b-4059-8668-15126f92d441 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:15.137604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:15.138191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:15.138470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:15.138739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] PATH_INFO: `/v3/users/a3689df36c15478f84beee66bac66e99` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:15.139837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] RBAC: Authorizing `identity:get_user(user_id=a3689df36c15478f84beee66bac66e99)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:15.141247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:15.142830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 553/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:15 2022] GET /identity/v3/users/a3689df36c15478f84beee66bac66e99 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:15.148458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:15.245922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3a731-1e9e-498e-a268-bdeb0e755aec None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:15.278907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b4da2-e906-400b-a4d2-3e3ae7d4ac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:15.279513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b4da2-e906-400b-a4d2-3e3ae7d4ac77 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:15.279792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b4da2-e906-400b-a4d2-3e3ae7d4ac77 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:15.280063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b4da2-e906-400b-a4d2-3e3ae7d4ac77 None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:15.281174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b4da2-e906-400b-a4d2-3e3ae7d4ac77 None admin] RBAC: Authorizing `identity:get_project(project_id=92087e4c892d4a718628b5b3eacb01b4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:15.282620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b4da2-e906-400b-a4d2-3e3ae7d4ac77 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:15.284206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 569/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:15 2022] GET /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:15.290009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:15.386318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69acae-c461-4dd5-9c65-a3d625eebd6f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:15.419513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3f413-c299-4d08-85e1-4a87eaca53fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:15.420149 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3f413-c299-4d08-85e1-4a87eaca53fa None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:15.420425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3f413-c299-4d08-85e1-4a87eaca53fa None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:15.420695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3f413-c299-4d08-85e1-4a87eaca53fa None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4/users/a3689df36c15478f84beee66bac66e99/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:15.422781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3f413-c299-4d08-85e1-4a87eaca53fa None admin] RBAC: Authorizing `identity:create_grant(project_id=92087e4c892d4a718628b5b3eacb01b4, user_id=a3689df36c15478f84beee66bac66e99, role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:15.424188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3f413-c299-4d08-85e1-4a87eaca53fa None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:15.436766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 554/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:46:15 2022] PUT /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4/users/a3689df36c15478f84beee66bac66e99/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:46:17.591698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb7d8-9b6a-4f5a-af94-ce1f23e7403b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:17.592256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb7d8-9b6a-4f5a-af94-ce1f23e7403b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:17.592256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaeb7d8-9b6a-4f5a-af94-ce1f23e7403b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:17.593562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 570/1124] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:17.598783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893519-631a-4813-aacb-12db9c14abf6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:17.599176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893519-631a-4813-aacb-12db9c14abf6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:17.599330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9893519-631a-4813-aacb-12db9c14abf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:17.617854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a9893519-631a-4813-aacb-12db9c14abf6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:17.619079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a9893519-631a-4813-aacb-12db9c14abf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:17.626353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:17.685557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 555/1125] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:17.951310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb7d8-9b6a-4f5a-af94-ce1f23e7403b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:17.985803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:18.050869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaeb7d8-9b6a-4f5a-af94-ce1f23e7403b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:18.083873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:18.084488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:18.084772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:18.085041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] PATH_INFO: `/v3/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:18.086441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] RBAC: Authorizing `identity:get_role(role_id=e3dd2a42707946dfb32f4ef0b8d2ebcf)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:18.087802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:18.089757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 571/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:17 2022] GET /identity/v3/roles/e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:18.095533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9893519-631a-4813-aacb-12db9c14abf6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:18.190487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9893519-631a-4813-aacb-12db9c14abf6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:18.224218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:18.224790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:18.225045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:18.225308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] PATH_INFO: `/v3/users/a3689df36c15478f84beee66bac66e99` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:18.226428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] RBAC: Authorizing `identity:get_user(user_id=a3689df36c15478f84beee66bac66e99)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:18.227827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:18.229563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 556/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:18 2022] GET /identity/v3/users/a3689df36c15478f84beee66bac66e99 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:18.235381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:18.330713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d384e-59c4-439d-b9f3-d8a7d6d5c6a6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:18.332438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:18.364235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:18.364818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:18.365090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:18.365352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:18.428741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:18.430191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:18.527077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 572/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:18.533126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:18.545174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:18.630174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485952-ecb5-4eea-b820-84266f415829 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:18.663084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d25f1-cc1e-40dc-b326-7c5834b36e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:18.663695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d25f1-cc1e-40dc-b326-7c5834b36e20 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:18.663972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d25f1-cc1e-40dc-b326-7c5834b36e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:18.664241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d25f1-cc1e-40dc-b326-7c5834b36e20 None admin] PATH_INFO: `/v3/projects/92087e4c892d4a718628b5b3eacb01b4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:18.665332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d25f1-cc1e-40dc-b326-7c5834b36e20 None admin] RBAC: Authorizing `identity:get_project(project_id=92087e4c892d4a718628b5b3eacb01b4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:18.667423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d25f1-cc1e-40dc-b326-7c5834b36e20 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:18.669074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 557/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:18 2022] GET /identity/v3/projects/92087e4c892d4a718628b5b3eacb01b4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:18.675201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:18.677337 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:18.774420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803aa5a8-da51-4de9-b6e2-ffe1745aa0f3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:18.808512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4874c-c9cd-403f-867e-578ffcd22096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:18.809043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4874c-c9cd-403f-867e-578ffcd22096 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:18.809324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4874c-c9cd-403f-867e-578ffcd22096 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:18.809596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4874c-c9cd-403f-867e-578ffcd22096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:18.810338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4874c-c9cd-403f-867e-578ffcd22096 None admin] RBAC: Adding query filter params (role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf, scope.project.id=92087e4c892d4a718628b5b3eacb01b4, user.id=a3689df36c15478f84beee66bac66e99) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:18.810645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4874c-c9cd-403f-867e-578ffcd22096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:18.812061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4874c-c9cd-403f-867e-578ffcd22096 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:18.817689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 573/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:18 2022] GET /identity/v3/role_assignments?user.id=a3689df36c15478f84beee66bac66e99&scope.project.id=92087e4c892d4a718628b5b3eacb01b4&role.id=e3dd2a42707946dfb32f4ef0b8d2ebcf => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:20.959475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64551d-04d2-499e-8883-a8914a6e84d6 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:20.959976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64551d-04d2-499e-8883-a8914a6e84d6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:20.959976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64551d-04d2-499e-8883-a8914a6e84d6 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:20.961265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 558/1131] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:20.967023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84c037-b542-49a3-9e58-e690026d7454 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:20.967440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84c037-b542-49a3-9e58-e690026d7454 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:20.967548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84c037-b542-49a3-9e58-e690026d7454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:20.985840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9e84c037-b542-49a3-9e58-e690026d7454 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:20.987040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9e84c037-b542-49a3-9e58-e690026d7454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:21.045180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:21.052635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 574/1132] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:21.325354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64551d-04d2-499e-8883-a8914a6e84d6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:21.402834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:21.425483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64551d-04d2-499e-8883-a8914a6e84d6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:21.458180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88af99-efb3-4016-94e5-33d418adaeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:21.458794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88af99-efb3-4016-94e5-33d418adaeca None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:21.459073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88af99-efb3-4016-94e5-33d418adaeca None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:21.459341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88af99-efb3-4016-94e5-33d418adaeca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:21.460436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88af99-efb3-4016-94e5-33d418adaeca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:21.461854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88af99-efb3-4016-94e5-33d418adaeca None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:21.463951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 559/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:46:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:21.469850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84c037-b542-49a3-9e58-e690026d7454 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:21.565273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84c037-b542-49a3-9e58-e690026d7454 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:21.600576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc41e5-01c9-45b8-9827-e91964959423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:21.601522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc41e5-01c9-45b8-9827-e91964959423 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:21.602014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc41e5-01c9-45b8-9827-e91964959423 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:21.602548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc41e5-01c9-45b8-9827-e91964959423 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:21.603745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc41e5-01c9-45b8-9827-e91964959423 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:21.606682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc41e5-01c9-45b8-9827-e91964959423 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:21.633058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 575/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:46:21 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:46:23.796867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b72a7-92d9-43d8-9198-84286a1a63a6 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:23.797410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b72a7-92d9-43d8-9198-84286a1a63a6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:23.797410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b72a7-92d9-43d8-9198-84286a1a63a6 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:23.798795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 560/1135] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:23.803984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154d87c-b1a7-4429-bc35-8c1db3dda370 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:23.804352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154d87c-b1a7-4429-bc35-8c1db3dda370 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:23.804535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154d87c-b1a7-4429-bc35-8c1db3dda370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:23.823556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6154d87c-b1a7-4429-bc35-8c1db3dda370 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:23.824722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6154d87c-b1a7-4429-bc35-8c1db3dda370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:23.866204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:23.891016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 576/1136] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:24.159981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b72a7-92d9-43d8-9198-84286a1a63a6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:24.259122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b72a7-92d9-43d8-9198-84286a1a63a6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:24.292310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495ea5b-705d-4854-af72-e48c9340b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:24.292916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ea5b-705d-4854-af72-e48c9340b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:24.293193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ea5b-705d-4854-af72-e48c9340b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:24.293459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ea5b-705d-4854-af72-e48c9340b2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:24.294577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495ea5b-705d-4854-af72-e48c9340b2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:24.295981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495ea5b-705d-4854-af72-e48c9340b2e5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:24.297510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 561/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:46:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:24.303292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154d87c-b1a7-4429-bc35-8c1db3dda370 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:24.399009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154d87c-b1a7-4429-bc35-8c1db3dda370 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:24.432602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddec75-b13e-460d-81ba-52c420415208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:24.433138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddec75-b13e-460d-81ba-52c420415208 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:24.433416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddec75-b13e-460d-81ba-52c420415208 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:24.433713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddec75-b13e-460d-81ba-52c420415208 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:24.434411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddec75-b13e-460d-81ba-52c420415208 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:24.435834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddec75-b13e-460d-81ba-52c420415208 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:24.456560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 577/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:46:24 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:46:26.668534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a9b8-ae43-4df5-b415-4e85710b1c21 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:26.669074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a9b8-ae43-4df5-b415-4e85710b1c21 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:26.669074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a9b8-ae43-4df5-b415-4e85710b1c21 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:26.670410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 562/1139] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:26.676049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890108-9e2f-4aae-8c31-e6b96b1bd920 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:26.676489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890108-9e2f-4aae-8c31-e6b96b1bd920 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:26.676579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890108-9e2f-4aae-8c31-e6b96b1bd920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:26.699260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-18890108-9e2f-4aae-8c31-e6b96b1bd920 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:26.700450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-18890108-9e2f-4aae-8c31-e6b96b1bd920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:26.730157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:26.776147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 578/1140] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:27.060679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a9b8-ae43-4df5-b415-4e85710b1c21 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:27.077332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:27.167344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a9b8-ae43-4df5-b415-4e85710b1c21 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:27.200595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:27.201209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:27.201483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:27.201748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:27.211595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:27.216821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:27.217904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:27.219023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 563/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:27.224164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18890108-9e2f-4aae-8c31-e6b96b1bd920 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:27.320335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18890108-9e2f-4aae-8c31-e6b96b1bd920 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:27.353725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:27.354350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:27.354630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:27.354902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:27.355955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:27.356265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:27.357648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:27.365579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 579/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:27.372193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:27.445953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:27.471273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab06cbc-61a0-4af7-94bb-6af838dd7ae4 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:27.504970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:27.505586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:27.505865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:27.506159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] PATH_INFO: `/v3/users/832310f0d4f245fa9f2626664107db04` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:27.519524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] RBAC: Authorizing `identity:get_user(user_id=832310f0d4f245fa9f2626664107db04)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:27.520956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:27.522593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 564/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:27 2022] GET /identity/v3/users/832310f0d4f245fa9f2626664107db04 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:27.528565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:27.556258 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:27.628884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8bff1-bf0b-46e4-8fee-5425d0e4803d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:27.662026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:27.662653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:27.663147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:27.663516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:27.731161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:27.732721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:27.758149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:27.828680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 580/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:27.834859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:27.930915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3a087-459b-4bd5-92cb-f75ec6846852 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:27.959939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:27.965296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f41340-84c4-4f46-ab2e-aae8c245529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:27.965912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f41340-84c4-4f46-ab2e-aae8c245529b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:27.966218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f41340-84c4-4f46-ab2e-aae8c245529b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:27.966492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f41340-84c4-4f46-ab2e-aae8c245529b None admin] PATH_INFO: `/v3/projects/848a07e037284b459bb3a9ae1b94c962` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:27.967592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f41340-84c4-4f46-ab2e-aae8c245529b None admin] RBAC: Authorizing `identity:get_project(project_id=848a07e037284b459bb3a9ae1b94c962)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:27.968997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f41340-84c4-4f46-ab2e-aae8c245529b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:27.970655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 565/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:27 2022] GET /identity/v3/projects/848a07e037284b459bb3a9ae1b94c962 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:27.976679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:28.073660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29de9-98d9-4ada-a95a-686226b797cf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:28.099298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:28.108677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c9e57-1d48-403d-8330-d0e82c39b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:28.109262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9e57-1d48-403d-8330-d0e82c39b83c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:28.109536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9e57-1d48-403d-8330-d0e82c39b83c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:28.109801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c9e57-1d48-403d-8330-d0e82c39b83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:28.110545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9e57-1d48-403d-8330-d0e82c39b83c None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=848a07e037284b459bb3a9ae1b94c962, user.id=832310f0d4f245fa9f2626664107db04) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:28.110846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9e57-1d48-403d-8330-d0e82c39b83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:28.112243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c9e57-1d48-403d-8330-d0e82c39b83c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:28.117453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 581/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:27 2022] GET /identity/v3/role_assignments?user.id=832310f0d4f245fa9f2626664107db04&scope.project.id=848a07e037284b459bb3a9ae1b94c962&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:30.209657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa1d8-3ad8-4c5c-8a97-849ca86d20ef None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:30.210206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa1d8-3ad8-4c5c-8a97-849ca86d20ef None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:30.210338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aa1d8-3ad8-4c5c-8a97-849ca86d20ef None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:30.211546 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 566/1147] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:30.218286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3909e89-6ed4-4fd0-89b2-5454501e8308 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:30.218658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3909e89-6ed4-4fd0-89b2-5454501e8308 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:30.218823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3909e89-6ed4-4fd0-89b2-5454501e8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:30.236688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c3909e89-6ed4-4fd0-89b2-5454501e8308 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:30.237855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c3909e89-6ed4-4fd0-89b2-5454501e8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:30.302296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 582/1148] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:30.575350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa1d8-3ad8-4c5c-8a97-849ca86d20ef None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:30.674456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aa1d8-3ad8-4c5c-8a97-849ca86d20ef None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:30.707520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:30.708138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:30.708414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:30.708680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:30.719005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:30.723671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:30.724723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:30.725764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 567/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:30.731094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3909e89-6ed4-4fd0-89b2-5454501e8308 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:30.827572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3909e89-6ed4-4fd0-89b2-5454501e8308 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:30.847549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:30.862074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:30.862701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:30.862977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:30.863247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:30.863900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:30.864199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:30.865550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:30.873416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 583/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:30.879170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:30.937075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:30.978443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac987-f329-4ca8-b7dd-3e5847c0e591 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:31.011778 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:31.012441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:31.012702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:31.012970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] PATH_INFO: `/v3/users/832310f0d4f245fa9f2626664107db04` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:31.014072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] RBAC: Authorizing `identity:get_user(user_id=832310f0d4f245fa9f2626664107db04)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:31.015513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:31.017072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 568/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:30 2022] GET /identity/v3/users/832310f0d4f245fa9f2626664107db04 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:31.022815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:31.121425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c74755-4a07-4ed8-8172-902b90c5dbbf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:31.154383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641d54-6945-46e9-a3c6-1fb88a0e0a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:31.154995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641d54-6945-46e9-a3c6-1fb88a0e0a47 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:31.155271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641d54-6945-46e9-a3c6-1fb88a0e0a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:31.155540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641d54-6945-46e9-a3c6-1fb88a0e0a47 None admin] PATH_INFO: `/v3/projects/848a07e037284b459bb3a9ae1b94c962` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:31.156641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641d54-6945-46e9-a3c6-1fb88a0e0a47 None admin] RBAC: Authorizing `identity:get_project(project_id=848a07e037284b459bb3a9ae1b94c962)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:31.158057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641d54-6945-46e9-a3c6-1fb88a0e0a47 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:31.159684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 584/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:31 2022] GET /identity/v3/projects/848a07e037284b459bb3a9ae1b94c962 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:31.165520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:31.262258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d7e7-2f7a-4059-8cf2-359f3ec9441f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:31.287115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:31.294860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96382c-969d-4179-afc4-7f723186af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:31.295503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96382c-969d-4179-afc4-7f723186af09 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:31.295782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96382c-969d-4179-afc4-7f723186af09 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:31.296055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96382c-969d-4179-afc4-7f723186af09 None admin] PATH_INFO: `/v3/projects/848a07e037284b459bb3a9ae1b94c962/users/832310f0d4f245fa9f2626664107db04/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:31.297925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96382c-969d-4179-afc4-7f723186af09 None admin] RBAC: Authorizing `identity:create_grant(project_id=848a07e037284b459bb3a9ae1b94c962, user_id=832310f0d4f245fa9f2626664107db04, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:31.299378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96382c-969d-4179-afc4-7f723186af09 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:31.312021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 569/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:46:31 2022] PUT /identity/v3/projects/848a07e037284b459bb3a9ae1b94c962/users/832310f0d4f245fa9f2626664107db04/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:46:33.402850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c72c8-3cc8-4c2c-9f58-c081d021bac6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:33.403452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c72c8-3cc8-4c2c-9f58-c081d021bac6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:33.403452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c72c8-3cc8-4c2c-9f58-c081d021bac6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:33.404704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 585/1154] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:46:33.410213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214493-43fb-43a9-a74b-15298e51332d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:33.410629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214493-43fb-43a9-a74b-15298e51332d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:33.410758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87214493-43fb-43a9-a74b-15298e51332d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:33.429127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-87214493-43fb-43a9-a74b-15298e51332d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:33.430342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-87214493-43fb-43a9-a74b-15298e51332d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:33.495094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 570/1155] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:33.778823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c72c8-3cc8-4c2c-9f58-c081d021bac6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:33.828456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:33.877903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c72c8-3cc8-4c2c-9f58-c081d021bac6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:33.910630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:33.911242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:33.911521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:33.911794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:33.921994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:33.926750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:33.927902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:46:33.928815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 586/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:33.933976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87214493-43fb-43a9-a74b-15298e51332d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:34.029646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87214493-43fb-43a9-a74b-15298e51332d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:34.046755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:34.066562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:34.067352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:34.067621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:34.067881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:34.068524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:34.068817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:34.070212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:34.080165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 571/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:34.086409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:34.183116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd817631-a7a8-4892-96f6-14805ed2ff6d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:34.192918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:34.216351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:34.216959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:34.217511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:34.217782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] PATH_INFO: `/v3/users/832310f0d4f245fa9f2626664107db04` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:34.218919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] RBAC: Authorizing `identity:get_user(user_id=832310f0d4f245fa9f2626664107db04)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:34.220335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:34.221874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 587/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:34 2022] GET /identity/v3/users/832310f0d4f245fa9f2626664107db04 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:34.227656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:34.323199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d1e99-8ec4-413d-a22d-35d70e21d057 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:34.355595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:34.356182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:34.356456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:34.356720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:34.402073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:34.420572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:34.422000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:34.514634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 572/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:34.520539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:34.617825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cc500-52d2-43fb-8332-1d918ef44e7d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:34.650668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c946c3-80d2-442e-a98c-f795bcba7508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:34.651296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c946c3-80d2-442e-a98c-f795bcba7508 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:34.651570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c946c3-80d2-442e-a98c-f795bcba7508 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:34.651839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c946c3-80d2-442e-a98c-f795bcba7508 None admin] PATH_INFO: `/v3/projects/848a07e037284b459bb3a9ae1b94c962` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:34.652948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c946c3-80d2-442e-a98c-f795bcba7508 None admin] RBAC: Authorizing `identity:get_project(project_id=848a07e037284b459bb3a9ae1b94c962)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:34.654397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c946c3-80d2-442e-a98c-f795bcba7508 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:34.655975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 588/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:34 2022] GET /identity/v3/projects/848a07e037284b459bb3a9ae1b94c962 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:34.661917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:34.739727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:34.758883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37534849-429b-4452-a8f2-c9052e00d90a None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:34.791574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3713cf-f075-466b-a343-2b56179ee793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:34.792166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3713cf-f075-466b-a343-2b56179ee793 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:34.792444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3713cf-f075-466b-a343-2b56179ee793 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:34.792715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3713cf-f075-466b-a343-2b56179ee793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:34.793428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3713cf-f075-466b-a343-2b56179ee793 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=848a07e037284b459bb3a9ae1b94c962, user.id=832310f0d4f245fa9f2626664107db04) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:34.793736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3713cf-f075-466b-a343-2b56179ee793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:34.795178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3713cf-f075-466b-a343-2b56179ee793 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:34.800694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 573/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:34 2022] GET /identity/v3/role_assignments?user.id=832310f0d4f245fa9f2626664107db04&scope.project.id=848a07e037284b459bb3a9ae1b94c962&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:36.924146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885e8b-b2ef-4aa4-95f2-f7f8eca740cd None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:36.924641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885e8b-b2ef-4aa4-95f2-f7f8eca740cd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:36.924641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885e8b-b2ef-4aa4-95f2-f7f8eca740cd None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:36.925951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 589/1162] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:36.931237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176492d-70db-461e-996a-2026513ebe3f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:36.931870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176492d-70db-461e-996a-2026513ebe3f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:36.932039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176492d-70db-461e-996a-2026513ebe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:36.950053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3176492d-70db-461e-996a-2026513ebe3f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:36.951254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3176492d-70db-461e-996a-2026513ebe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:37.016734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 574/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:37.282252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885e8b-b2ef-4aa4-95f2-f7f8eca740cd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:37.328526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:37.380853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885e8b-b2ef-4aa4-95f2-f7f8eca740cd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:37.412894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e60be-5813-400b-ab91-d94433636816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:37.413475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e60be-5813-400b-ab91-d94433636816 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:37.413749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e60be-5813-400b-ab91-d94433636816 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:37.414019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e60be-5813-400b-ab91-d94433636816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:37.478955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e60be-5813-400b-ab91-d94433636816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:37.480369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e60be-5813-400b-ab91-d94433636816 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:37.522456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:37.576264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 590/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:37.582293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176492d-70db-461e-996a-2026513ebe3f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:37.656136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:37.680335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176492d-70db-461e-996a-2026513ebe3f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:37.715715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65812afc-fe85-46c8-8162-29ee0a086cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:37.716346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812afc-fe85-46c8-8162-29ee0a086cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:37.716624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812afc-fe85-46c8-8162-29ee0a086cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:37.716894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65812afc-fe85-46c8-8162-29ee0a086cf9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:37.723485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65812afc-fe85-46c8-8162-29ee0a086cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:37.724914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65812afc-fe85-46c8-8162-29ee0a086cf9 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-65812afc-fe85-46c8-8162-29ee0a086cf9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:37.736098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:37.737353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:37.738356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 575/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:46:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:37.743136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e60be-5813-400b-ab91-d94433636816 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:37.842736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e60be-5813-400b-ab91-d94433636816 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:37.875847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f3f80-05d8-44cd-9c0d-098bd079ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:37.876430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f3f80-05d8-44cd-9c0d-098bd079ec26 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:37.876701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f3f80-05d8-44cd-9c0d-098bd079ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:37.876966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f3f80-05d8-44cd-9c0d-098bd079ec26 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:37.877589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f3f80-05d8-44cd-9c0d-098bd079ec26 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:37.877883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f3f80-05d8-44cd-9c0d-098bd079ec26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:37.879343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f3f80-05d8-44cd-9c0d-098bd079ec26 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:37.887258 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 591/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Sep 9 14:46:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:46:39.989062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85ea2-ddea-4dfb-bd8f-31eb409bf8b2 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:39.989578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85ea2-ddea-4dfb-bd8f-31eb409bf8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:39.989578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85ea2-ddea-4dfb-bd8f-31eb409bf8b2 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:39.990876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 576/1167] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:39.996817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d394f20-71cd-4cbb-b34e-80de5be3f688 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:39.997209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d394f20-71cd-4cbb-b34e-80de5be3f688 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:39.997373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d394f20-71cd-4cbb-b34e-80de5be3f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:40.015291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9d394f20-71cd-4cbb-b34e-80de5be3f688 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:40.016464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9d394f20-71cd-4cbb-b34e-80de5be3f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:40.019205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:40.082020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 592/1168] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:40.346614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb85ea2-ddea-4dfb-bd8f-31eb409bf8b2 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:40.442470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb85ea2-ddea-4dfb-bd8f-31eb409bf8b2 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:40.475150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff147e8a-1eec-4e37-957d-3f3a9bc5264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:40.475730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff147e8a-1eec-4e37-957d-3f3a9bc5264c None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:40.476005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff147e8a-1eec-4e37-957d-3f3a9bc5264c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:40.476273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff147e8a-1eec-4e37-957d-3f3a9bc5264c None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:40.476926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff147e8a-1eec-4e37-957d-3f3a9bc5264c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:40.478471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff147e8a-1eec-4e37-957d-3f3a9bc5264c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:40.482115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:40.493846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 577/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Fri Sep 9 14:46:40 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:46:42.628431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea3764-f4a3-45e9-bd73-af6dc327de6f None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:42.628963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea3764-f4a3-45e9-bd73-af6dc327de6f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:42.629078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea3764-f4a3-45e9-bd73-af6dc327de6f None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:42.630443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 593/1170] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:42.636133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1af39-3c42-4da6-be46-69121d9a938d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:42.636571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1af39-3c42-4da6-be46-69121d9a938d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:42.636664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1af39-3c42-4da6-be46-69121d9a938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:42.654967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2df1af39-3c42-4da6-be46-69121d9a938d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:42.656129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2df1af39-3c42-4da6-be46-69121d9a938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:42.720187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 578/1171] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:46:42.987675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea3764-f4a3-45e9-bd73-af6dc327de6f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:43.089155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea3764-f4a3-45e9-bd73-af6dc327de6f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:43.122060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a76521-451d-4d16-a390-a96240d1088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:43.122696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76521-451d-4d16-a390-a96240d1088d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:43.122970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76521-451d-4d16-a390-a96240d1088d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:43.123237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a76521-451d-4d16-a390-a96240d1088d None admin] PATH_INFO: `/v3/domains/3f959abdcfd0445383f084e78a6e64a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:43.131097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:43.133722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a76521-451d-4d16-a390-a96240d1088d None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f959abdcfd0445383f084e78a6e64a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:43.136250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a76521-451d-4d16-a390-a96240d1088d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:43.138170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 594/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Fri Sep 9 14:46:42 2022] GET /identity/v3/domains/3f959abdcfd0445383f084e78a6e64a2 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:43.143714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1af39-3c42-4da6-be46-69121d9a938d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:43.238730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1af39-3c42-4da6-be46-69121d9a938d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:43.261838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:43.272671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30c67c-0fca-4f8a-8c07-efef6be415dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:43.273267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c67c-0fca-4f8a-8c07-efef6be415dc None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:43.273545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c67c-0fca-4f8a-8c07-efef6be415dc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:43.273813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30c67c-0fca-4f8a-8c07-efef6be415dc None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:43.274559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30c67c-0fca-4f8a-8c07-efef6be415dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:43.276030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30c67c-0fca-4f8a-8c07-efef6be415dc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:43.301110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 579/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:46:43 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:46:45.471826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42bba-086f-428b-83c8-5ab82a7f1220 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:45.472389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42bba-086f-428b-83c8-5ab82a7f1220 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:45.472389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42bba-086f-428b-83c8-5ab82a7f1220 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:45.473697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 595/1174] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:45.478983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb2e5-961f-4f21-8041-35d73cce7384 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:45.479354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb2e5-961f-4f21-8041-35d73cce7384 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:45.479525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb2e5-961f-4f21-8041-35d73cce7384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:45.497816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-46deb2e5-961f-4f21-8041-35d73cce7384 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:45.499030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-46deb2e5-961f-4f21-8041-35d73cce7384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:45.562608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 580/1175] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:45.848794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42bba-086f-428b-83c8-5ab82a7f1220 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:45.948993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42bba-086f-428b-83c8-5ab82a7f1220 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:45.981970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82a3b1-d6cc-49d3-8f94-15fa62f9783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:45.982612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a3b1-d6cc-49d3-8f94-15fa62f9783e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:45.982892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a3b1-d6cc-49d3-8f94-15fa62f9783e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:45.983166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82a3b1-d6cc-49d3-8f94-15fa62f9783e None admin] PATH_INFO: `/v3/domains/3f959abdcfd0445383f084e78a6e64a2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:45.984268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82a3b1-d6cc-49d3-8f94-15fa62f9783e None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f959abdcfd0445383f084e78a6e64a2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:45.985696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82a3b1-d6cc-49d3-8f94-15fa62f9783e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:45.987263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 596/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Fri Sep 9 14:46:45 2022] GET /identity/v3/domains/3f959abdcfd0445383f084e78a6e64a2 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:45.992875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb2e5-961f-4f21-8041-35d73cce7384 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:46.092144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb2e5-961f-4f21-8041-35d73cce7384 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:46.099227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:46.125885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10ff71-2592-48e3-a0e8-e82825f524bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:46.126512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ff71-2592-48e3-a0e8-e82825f524bc None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:46.126790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ff71-2592-48e3-a0e8-e82825f524bc None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:46.127059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10ff71-2592-48e3-a0e8-e82825f524bc None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:46.127695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10ff71-2592-48e3-a0e8-e82825f524bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:46.129106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10ff71-2592-48e3-a0e8-e82825f524bc None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:46.148669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 581/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:46:45 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:46:48.335304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9ab6-b91e-4a15-a55b-0ba17f4fa002 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:48.335839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9ab6-b91e-4a15-a55b-0ba17f4fa002 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:48.335839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9ab6-b91e-4a15-a55b-0ba17f4fa002 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:48.337823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 597/1178] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:48.343137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1e5f-4ee4-425d-b614-c93fae70f9fd None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:48.343572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1e5f-4ee4-425d-b614-c93fae70f9fd None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:48.343671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1e5f-4ee4-425d-b614-c93fae70f9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:48.361947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-4a5d1e5f-4ee4-425d-b614-c93fae70f9fd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:48.363150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4a5d1e5f-4ee4-425d-b614-c93fae70f9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:48.426853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 582/1179] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:48.700659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9ab6-b91e-4a15-a55b-0ba17f4fa002 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:48.767193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:48.801018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9ab6-b91e-4a15-a55b-0ba17f4fa002 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:48.833655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:48.834294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:48.834574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:48.834847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:48.845760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:48.850530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:48.851592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:46:48.852457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 598/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:48.857876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1e5f-4ee4-425d-b614-c93fae70f9fd None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:48.945177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:48.955231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1e5f-4ee4-425d-b614-c93fae70f9fd None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:48.988099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:48.988695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:48.988975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:48.989247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:48.989900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:48.990236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:48.991581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:48.999822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 583/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:49.005747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:49.106050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab690-d422-4202-8ba1-1d943b6654ba None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:49.132221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:49.140752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:49.141372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:49.141652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:49.141926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] PATH_INFO: `/v3/users/98aab29de53d493a88e3477e627c3ed5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:49.154661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] RBAC: Authorizing `identity:get_user(user_id=98aab29de53d493a88e3477e627c3ed5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:49.156092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:49.157676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 599/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:49 2022] GET /identity/v3/users/98aab29de53d493a88e3477e627c3ed5 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:49.163428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:49.262383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f92-7b1e-4071-a13c-ee9f4f7a34c9 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:49.294520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:49.295107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:49.295378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:49.295648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:49.318668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:49.360936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:49.362395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:49.456070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 584/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:49.462207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:49.559726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb3bc3-da6c-4b39-bbe3-e92271020a28 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:49.592089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaa25a-3240-4741-b139-77b64e3ec505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:49.592698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa25a-3240-4741-b139-77b64e3ec505 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:49.592977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa25a-3240-4741-b139-77b64e3ec505 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:49.593251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaa25a-3240-4741-b139-77b64e3ec505 None admin] PATH_INFO: `/v3/projects/ca123dfec55e436e8de3172519534d42` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:49.594387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaa25a-3240-4741-b139-77b64e3ec505 None admin] RBAC: Authorizing `identity:get_project(project_id=ca123dfec55e436e8de3172519534d42)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:49.595805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaa25a-3240-4741-b139-77b64e3ec505 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:49.597393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 600/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:49 2022] GET /identity/v3/projects/ca123dfec55e436e8de3172519534d42 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:49.604276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:49.656780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:49.700279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37faa012-c9cb-4c79-a3cc-cc2ad3e4eabb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:49.734338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a97b-80cd-4d5f-a63d-2ffd62d17205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:49.734931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a97b-80cd-4d5f-a63d-2ffd62d17205 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:49.735204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a97b-80cd-4d5f-a63d-2ffd62d17205 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:49.735472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a97b-80cd-4d5f-a63d-2ffd62d17205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:49.736187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a97b-80cd-4d5f-a63d-2ffd62d17205 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=ca123dfec55e436e8de3172519534d42, user.id=98aab29de53d493a88e3477e627c3ed5) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:49.736492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a97b-80cd-4d5f-a63d-2ffd62d17205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:49.737892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a97b-80cd-4d5f-a63d-2ffd62d17205 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:49.743691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 585/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:49 2022] GET /identity/v3/role_assignments?user.id=98aab29de53d493a88e3477e627c3ed5&scope.project.id=ca123dfec55e436e8de3172519534d42&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:51.856433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8646aa-ebf5-4baa-84d6-408858950e3e None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:51.857017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8646aa-ebf5-4baa-84d6-408858950e3e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:51.857017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8646aa-ebf5-4baa-84d6-408858950e3e None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:51.858301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 601/1186] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:51.863451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb009029-e4f8-486d-8d20-72229891ad47 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:51.863838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb009029-e4f8-486d-8d20-72229891ad47 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:51.863997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb009029-e4f8-486d-8d20-72229891ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:51.881684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-bb009029-e4f8-486d-8d20-72229891ad47 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:51.882886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bb009029-e4f8-486d-8d20-72229891ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:51.945846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 586/1187] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:52.210878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8646aa-ebf5-4baa-84d6-408858950e3e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:52.266238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:52.312047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8646aa-ebf5-4baa-84d6-408858950e3e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:52.345580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:52.346228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:52.346511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:52.346781 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:52.357327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:52.362065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:52.363173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:46:52.364209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 602/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:52.369592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb009029-e4f8-486d-8d20-72229891ad47 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:52.417326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:52.467084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb009029-e4f8-486d-8d20-72229891ad47 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:52.500450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:52.501043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:52.501321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:52.501592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:52.502276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:52.502578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:52.503932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:52.512278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 587/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:46:52.518079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:52.615759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a65cae-ad96-49e3-a466-2cad9311e95a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:52.629169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:52.649229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:52.650459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:52.650741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:52.651013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] PATH_INFO: `/v3/users/98aab29de53d493a88e3477e627c3ed5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:52.652126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] RBAC: Authorizing `identity:get_user(user_id=98aab29de53d493a88e3477e627c3ed5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:52.653545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:52.655124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 603/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:52 2022] GET /identity/v3/users/98aab29de53d493a88e3477e627c3ed5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:52.660824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:52.760163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c7edb-8601-4f92-a652-672665111a38 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:52.769907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:52.792863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef87cd0-2ba7-4bab-a24e-bbe09077f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:52.793481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87cd0-2ba7-4bab-a24e-bbe09077f74f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:52.793759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87cd0-2ba7-4bab-a24e-bbe09077f74f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:52.794030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef87cd0-2ba7-4bab-a24e-bbe09077f74f None admin] PATH_INFO: `/v3/projects/ca123dfec55e436e8de3172519534d42` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:52.795158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef87cd0-2ba7-4bab-a24e-bbe09077f74f None admin] RBAC: Authorizing `identity:get_project(project_id=ca123dfec55e436e8de3172519534d42)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:52.796579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef87cd0-2ba7-4bab-a24e-bbe09077f74f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:52.798225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 588/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:52 2022] GET /identity/v3/projects/ca123dfec55e436e8de3172519534d42 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:52.804128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:52.901608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731a04c-aabc-4b69-b578-9feda8a7aca8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:52.934526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03298214-4719-4f23-aefe-e9a178d51619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:52.935163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298214-4719-4f23-aefe-e9a178d51619 None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:52.935441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298214-4719-4f23-aefe-e9a178d51619 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:52.935710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03298214-4719-4f23-aefe-e9a178d51619 None admin] PATH_INFO: `/v3/projects/ca123dfec55e436e8de3172519534d42/users/98aab29de53d493a88e3477e627c3ed5/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:52.937605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03298214-4719-4f23-aefe-e9a178d51619 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca123dfec55e436e8de3172519534d42, user_id=98aab29de53d493a88e3477e627c3ed5, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:52.939058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03298214-4719-4f23-aefe-e9a178d51619 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:52.951763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 604/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:46:52 2022] PUT /identity/v3/projects/ca123dfec55e436e8de3172519534d42/users/98aab29de53d493a88e3477e627c3ed5/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:46:55.079370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c0c3-37fc-4edc-a2a7-e90f32d38413 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:55.079895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c0c3-37fc-4edc-a2a7-e90f32d38413 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:55.079895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c0c3-37fc-4edc-a2a7-e90f32d38413 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:55.081490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 589/1193] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:46:55.086580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1800d-65d4-49e2-add5-1a8bc5a80939 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:55.086955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1800d-65d4-49e2-add5-1a8bc5a80939 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:55.087632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1800d-65d4-49e2-add5-1a8bc5a80939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:55.106376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-08e1800d-65d4-49e2-add5-1a8bc5a80939 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:46:55.107536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-08e1800d-65d4-49e2-add5-1a8bc5a80939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:46:55.140203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:55.172658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 605/1194] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:46:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:46:55.438457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c0c3-37fc-4edc-a2a7-e90f32d38413 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:55.538238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c0c3-37fc-4edc-a2a7-e90f32d38413 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:55.570166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:55.570795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:55.571056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:55.571319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:55.581795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:46:55.586566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:46:55.588271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:46:55.589266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 590/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:46:55.594070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1800d-65d4-49e2-add5-1a8bc5a80939 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:55.688111 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1800d-65d4-49e2-add5-1a8bc5a80939 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:55.722769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:55.723366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:55.723644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:55.723914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:55.724568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:55.724866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:55.726250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:55.734145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 606/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:55.739926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:55.779147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:55.842704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba81c6-918c-4c63-8bba-be8745b913e9 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:55.880369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:55.880984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:55.881259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:55.881526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] PATH_INFO: `/v3/users/98aab29de53d493a88e3477e627c3ed5` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:55.882666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] RBAC: Authorizing `identity:get_user(user_id=98aab29de53d493a88e3477e627c3ed5)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:55.884696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:55.886281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 591/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Sep 9 14:46:55 2022] GET /identity/v3/users/98aab29de53d493a88e3477e627c3ed5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:55.892047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:55.926923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:55.991941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9edb8b1-0788-4d50-8062-ea26f6f747ac None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:56.023672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:56.024265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:56.025136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:56.025426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:56.091196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:56.092635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:56.124353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:56.189647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 607/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:46:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:46:56.195517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:56.291873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a5e8d-25bb-484d-9b9d-5d0ba7f6597b None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:56.298788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:56.325094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56dfe7-142b-4c6d-99fc-91901846c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:56.325696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56dfe7-142b-4c6d-99fc-91901846c173 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:56.325971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56dfe7-142b-4c6d-99fc-91901846c173 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:56.326266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56dfe7-142b-4c6d-99fc-91901846c173 None admin] PATH_INFO: `/v3/projects/ca123dfec55e436e8de3172519534d42` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:56.327359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56dfe7-142b-4c6d-99fc-91901846c173 None admin] RBAC: Authorizing `identity:get_project(project_id=ca123dfec55e436e8de3172519534d42)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:56.328762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56dfe7-142b-4c6d-99fc-91901846c173 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:56.330388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 592/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Sep 9 14:46:56 2022] GET /identity/v3/projects/ca123dfec55e436e8de3172519534d42 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:46:56.336652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:46:56.433459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1f4f8-c7bc-4fd4-be7a-e83012c7c3ad None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:46:56.467475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b322e83-2a7c-4e3a-87bf-f9cf5a91cd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:46:56.468064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b322e83-2a7c-4e3a-87bf-f9cf5a91cd1e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:46:56.468342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b322e83-2a7c-4e3a-87bf-f9cf5a91cd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:46:56.468612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b322e83-2a7c-4e3a-87bf-f9cf5a91cd1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:46:56.469336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b322e83-2a7c-4e3a-87bf-f9cf5a91cd1e None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=ca123dfec55e436e8de3172519534d42, user.id=98aab29de53d493a88e3477e627c3ed5) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:46:56.469642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b322e83-2a7c-4e3a-87bf-f9cf5a91cd1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:46:56.471084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b322e83-2a7c-4e3a-87bf-f9cf5a91cd1e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:46:56.472832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:46:56.477763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 608/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:46:56 2022] GET /identity/v3/role_assignments?user.id=98aab29de53d493a88e3477e627c3ed5&scope.project.id=ca123dfec55e436e8de3172519534d42&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:47:06.320482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=13 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:06.476319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:51.952418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4a17-1d72-4122-81b0-2f4078be3eba None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:51.952980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4a17-1d72-4122-81b0-2f4078be3eba None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:51.952980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f4a17-1d72-4122-81b0-2f4078be3eba None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:51.954323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 593/1201] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:47:51.960187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590b8c-e878-4b5a-91b4-8dd5a32389e0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:51.960701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590b8c-e878-4b5a-91b4-8dd5a32389e0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:51.960810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590b8c-e878-4b5a-91b4-8dd5a32389e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:51.981544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ff590b8c-e878-4b5a-91b4-8dd5a32389e0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:47:51.982802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ff590b8c-e878-4b5a-91b4-8dd5a32389e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:47:52.067227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 609/1202] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:47:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:47:52.338970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4a17-1d72-4122-81b0-2f4078be3eba None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:52.472048 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f4a17-1d72-4122-81b0-2f4078be3eba None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:52.522137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:52.522785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:52.523091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:52.523364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:52.536367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:52.538554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:47:52.566943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:47:52.568430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:47:52.571569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:47:52.571569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:47:52.571569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:47:52.571569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 594/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:47:52.575021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590b8c-e878-4b5a-91b4-8dd5a32389e0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:52.715114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590b8c-e878-4b5a-91b4-8dd5a32389e0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:52.752272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:52.763604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659937ad-c981-43a1-b9a2-46fbf293d261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:52.764159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659937ad-c981-43a1-b9a2-46fbf293d261 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:52.764486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659937ad-c981-43a1-b9a2-46fbf293d261 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:52.764788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659937ad-c981-43a1-b9a2-46fbf293d261 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:52.765369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659937ad-c981-43a1-b9a2-46fbf293d261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:47:52.765783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659937ad-c981-43a1-b9a2-46fbf293d261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:52.767082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659937ad-c981-43a1-b9a2-46fbf293d261 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:52.782132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 610/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:47:52.785533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:52.855295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:52.908605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f6f93-8d9b-4dc4-98a1-c967dbe5ea80 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:52.950258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5240fcf-a53a-45f5-863b-cb50db7edbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:52.950802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5240fcf-a53a-45f5-863b-cb50db7edbc2 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:52.951073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5240fcf-a53a-45f5-863b-cb50db7edbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:52.951425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5240fcf-a53a-45f5-863b-cb50db7edbc2 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:52.952075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5240fcf-a53a-45f5-863b-cb50db7edbc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:52.953496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5240fcf-a53a-45f5-863b-cb50db7edbc2 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:52.984749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 595/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Sep 9 14:47:52 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:47:55.387768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be219776-2ec3-477b-bffd-ed657f5fc430 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:55.388352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be219776-2ec3-477b-bffd-ed657f5fc430 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:55.388352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be219776-2ec3-477b-bffd-ed657f5fc430 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:55.389764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 611/1206] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:47:55.401730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251cc57-ae91-4b87-8a39-debb017d20f8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:55.401730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251cc57-ae91-4b87-8a39-debb017d20f8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:55.401730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251cc57-ae91-4b87-8a39-debb017d20f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:55.420213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f251cc57-ae91-4b87-8a39-debb017d20f8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:47:55.421619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f251cc57-ae91-4b87-8a39-debb017d20f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:47:55.502933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 596/1207] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:47:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:47:55.815973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be219776-2ec3-477b-bffd-ed657f5fc430 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:55.945171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be219776-2ec3-477b-bffd-ed657f5fc430 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:55.990286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:55.990887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:55.991134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:55.991404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:56.002902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:47:56.008106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:47:56.009182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:47:56.010055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:47:56.011587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 612/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:47:56.017796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251cc57-ae91-4b87-8a39-debb017d20f8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:56.059978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:56.129493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251cc57-ae91-4b87-8a39-debb017d20f8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:56.173167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:56.174118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:56.175202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:56.175545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:56.176283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:47:56.176657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:56.179004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:56.188649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 597/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:47:56.194483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:56.253713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:56.313769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170613-297c-400a-b9ea-102134a72e49 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:56.355043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:56.355983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:56.356360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:56.356762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:56.371911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:56.373614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:47:56.389980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:47:56.391432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:47:56.392758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:47:56.392758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:47:56.392758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:47:56.398036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 613/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:47:56.398203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:56.505957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:56.509407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce1044-96fc-4ccb-b476-7f80c204bc0c None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:56.557648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:56.558289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:56.558665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:56.558901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:56.559748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:47:56.560103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:56.561614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:56.578427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 598/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:47:56.580203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:56.703651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670893d-506d-4d08-b8f9-eaa35ef89b6a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:56.705584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:56.742702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:56.743406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:56.743692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:56.743970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:56.752375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:56.753826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:47:56.767538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:47:56.768723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:47:56.769709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:47:56.773826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 614/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:47:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:47:56.779882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:56.884815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841cd62-a553-4e00-9326-da0041de9c91 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:56.921048 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:56.921658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:56.921939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:56.922240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:56.922968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:47:56.923272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:56.924687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:56.949754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 599/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Sep 9 14:47:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:47:56.950958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:57.063952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78702086-6ad9-42df-b0e6-fb98e9ceeee2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:57.107593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:57.108351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:57.108631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:57.108900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:57.142060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:57.188020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:57.189525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:57.309950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 615/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:47:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:47:57.315822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:57.336453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:57.424817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea451f8-2ec0-4198-ac7b-f955ad61588f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:57.462743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:57.463378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:57.463657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:57.463930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:57.474957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:57.476388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:47:57.491774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:47:57.492981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:47:57.493901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:47:57.493901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:47:57.493901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:47:57.493901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 600/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:47:57.498715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:57.567128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:57.614357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfec1e0-e10f-4735-a8a7-ccb9138a3e33 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:57.654322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:57.655097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:57.655429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:57.655802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:57.656584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:47:57.656968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:57.658577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:57.676581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 616/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:47:57.682289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:57.769018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:57.803356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cb014-3b00-48b1-80f8-9569818429f8 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:57.842955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:57.843511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:57.843792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:57.844067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:57.851538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:57.853020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:47:57.864485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:47:57.865448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:47:57.866694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 601/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:47:57.872230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:57.996720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba6c0-3552-470d-83ab-d6717a7d905d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:58.029362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:58.042938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a37902-a4b3-4109-819e-428041b0f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:58.043682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a37902-a4b3-4109-819e-428041b0f326 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:58.044037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a37902-a4b3-4109-819e-428041b0f326 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:58.044422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a37902-a4b3-4109-819e-428041b0f326 None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:58.045194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a37902-a4b3-4109-819e-428041b0f326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:47:58.045628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a37902-a4b3-4109-819e-428041b0f326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:58.047167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a37902-a4b3-4109-819e-428041b0f326 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:58.061079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 617/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:47:58.068539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:47:58.194604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488c6a-a4b9-44cf-8665-52c0e3414097 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:47:58.229849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:47:58.238012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9627be-0c53-4e1d-8564-243d810702d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:47:58.238776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9627be-0c53-4e1d-8564-243d810702d4 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:47:58.240925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9627be-0c53-4e1d-8564-243d810702d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:47:58.240925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9627be-0c53-4e1d-8564-243d810702d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:47:58.241215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9627be-0c53-4e1d-8564-243d810702d4 None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=ef370b70e8194df9a52c26e21c375730) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:47:58.241562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9627be-0c53-4e1d-8564-243d810702d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:47:58.243232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9627be-0c53-4e1d-8564-243d810702d4 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:47:58.249596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 602/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:47:58 2022] GET /identity/v3/role_assignments?user.id=ef370b70e8194df9a52c26e21c375730&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:00.575859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe7c8-01a8-4e92-8866-fd16381e1983 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:00.576447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe7c8-01a8-4e92-8866-fd16381e1983 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:00.576447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfe7c8-01a8-4e92-8866-fd16381e1983 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:00.577704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 618/1220] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:48:00.584355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab766f-81e9-4faa-b95c-d6ee97b3de65 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:00.584789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab766f-81e9-4faa-b95c-d6ee97b3de65 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:00.584950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab766f-81e9-4faa-b95c-d6ee97b3de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:00.603970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-72ab766f-81e9-4faa-b95c-d6ee97b3de65 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:00.605174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-72ab766f-81e9-4faa-b95c-d6ee97b3de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:00.681837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 603/1221] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 14:48:00.982449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfe7c8-01a8-4e92-8866-fd16381e1983 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:01.113181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfe7c8-01a8-4e92-8866-fd16381e1983 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:01.160144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:01.160778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:01.161070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:01.161371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:01.171794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:48:01.176600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:01.178153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:01.179070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 619/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:01.187221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab766f-81e9-4faa-b95c-d6ee97b3de65 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:01.300752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab766f-81e9-4faa-b95c-d6ee97b3de65 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:01.325301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:01.336879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:01.337550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:01.337828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:01.338145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:01.338867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:01.339188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:01.340717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:01.351114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 604/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:01.357489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:01.404064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:01.464613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe1eef-4953-4ad5-8a81-0e753f264acd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:01.501337 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:01.501961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:01.502302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:01.502578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:01.513548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:01.515165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:01.529987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:01.531185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:01.532299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:01.532299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:01.532299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:01.536917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 620/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:01.538300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:01.650824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b34642-e4c7-40c7-b57f-c83757143b59 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:01.690233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:01.691135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:01.691416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:01.691688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:01.692364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:01.692672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:01.694185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:01.708355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 605/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:48:01.714020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:01.824811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:01.833692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5787b37-e22f-4375-92d4-1728f7db6767 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:01.871261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:01.871898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:01.872180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:01.872452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:01.880360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:01.881852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:48:01.893254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:01.894444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:01.896146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 621/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:01.901420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:01.951370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:02.009697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e256600-6bf2-408e-8f8d-707ecba321ef None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:02.045623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:02.046278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:02.046540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:02.046813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:02.047545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:02.047889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:02.049233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:02.070202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 606/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Sep 9 14:48:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:48:02.076078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:02.186124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd194b19-1b6c-4f88-b9a8-ffb466169eb8 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:02.226216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:02.226955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:02.227197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:02.227479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:02.238368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:02.240110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:02.255519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:02.256792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:02.257715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:02.257715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:02.257715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:02.257715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 622/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:48:02.262441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:02.373966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2cb1c-67c8-483c-9b1f-a4fb167a1979 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:02.376326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:02.410312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:02.411051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:02.411440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:02.411688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:02.412285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:02.412629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:02.414059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:02.425359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 607/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:02.431240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:02.440800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:02.539139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a085e-913e-4c2f-b5ea-9352cb78741d None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:02.578166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:02.578799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:02.579079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:02.579632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:02.587199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:02.588646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:48:02.600148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:02.601225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:02.602271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 623/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:02.608052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:02.722819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b30e2-11ef-45f6-aa51-5298e57879f6 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:02.760382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d309dc-444b-4c95-b7cd-0d5a40cf7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:02.761085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d309dc-444b-4c95-b7cd-0d5a40cf7760 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:02.761367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d309dc-444b-4c95-b7cd-0d5a40cf7760 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:02.761682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d309dc-444b-4c95-b7cd-0d5a40cf7760 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:02.762451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d309dc-444b-4c95-b7cd-0d5a40cf7760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:02.762750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d309dc-444b-4c95-b7cd-0d5a40cf7760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:02.764213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d309dc-444b-4c95-b7cd-0d5a40cf7760 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:02.776945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 608/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:02.783526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:02.857738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:02.894421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac024e89-687d-4f84-88d6-a35a8cc34418 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:02.930101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e54111-8397-408b-b469-0d737347c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:02.930763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54111-8397-408b-b469-0d737347c2ed None admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:02.931044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54111-8397-408b-b469-0d737347c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:02.931317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54111-8397-408b-b469-0d737347c2ed None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/ef370b70e8194df9a52c26e21c375730/roles/6829f18de75049389086cb4eccc75948` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:02.946799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e54111-8397-408b-b469-0d737347c2ed None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=ef370b70e8194df9a52c26e21c375730, role_id=6829f18de75049389086cb4eccc75948)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:02.948395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e54111-8397-408b-b469-0d737347c2ed None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:02.961563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 624/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:48:02 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/ef370b70e8194df9a52c26e21c375730/roles/6829f18de75049389086cb4eccc75948 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:48:05.143181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dfd1e-d29d-4262-8bc5-7849957e7495 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:05.143845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dfd1e-d29d-4262-8bc5-7849957e7495 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:05.143845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dfd1e-d29d-4262-8bc5-7849957e7495 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:05.145050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 609/1233] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:48:05.151172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e7f2b-36ff-4c1e-886e-2df465e1d18b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:05.151656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e7f2b-36ff-4c1e-886e-2df465e1d18b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:05.151790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e7f2b-36ff-4c1e-886e-2df465e1d18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:05.170848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-951e7f2b-36ff-4c1e-886e-2df465e1d18b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:05.172053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-951e7f2b-36ff-4c1e-886e-2df465e1d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:05.253870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 625/1234] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:05.516399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dfd1e-d29d-4262-8bc5-7849957e7495 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:05.546830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:05.630449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dfd1e-d29d-4262-8bc5-7849957e7495 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:05.673097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:05.673835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:05.674185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:05.674529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:05.686461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:48:05.691958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:05.694132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:05.695374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 610/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Sep 9 14:48:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:05.700156 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e7f2b-36ff-4c1e-886e-2df465e1d18b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:05.756629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:05.814646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e7f2b-36ff-4c1e-886e-2df465e1d18b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:05.853679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:05.854523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:05.854830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:05.855107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:05.855816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:05.856217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:05.857718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:05.868282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 626/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Sep 9 14:48:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:05.875480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:05.966025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:05.981035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84218294-594a-4851-85cd-f2dfae75e5b7 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:06.018027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:06.018684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:06.018962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:06.019231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:06.030254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:06.031687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:06.046452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:06.047542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:06.048903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:06.048903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:06.048903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:06.048903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 611/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:06.053652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:06.173619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a1b64-b34d-4a12-b0f4-62d8ee4c8ef5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:06.183235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:06.216042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:06.216638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:06.216945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:06.217190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:06.217827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:06.218158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:06.219515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:06.232479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 627/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:06.238428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:06.355621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978016c5-ef4b-408d-b9b1-b71aa2c73a74 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:06.387327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:06.387881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:06.388156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:06.388445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:06.391166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:06.397200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:06.398658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:48:06.409757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:06.410974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:06.412147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 612/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:06.417362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:06.526874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417eee9-02f0-4ff6-b1cf-395ea9ead82a None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:06.563509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:06.564132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:06.564359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:06.564606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:06.565324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:06.565628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:06.567640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:06.586833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 628/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Sep 9 14:48:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:06.593067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:06.708092 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583277a8-6a0b-4272-ab1e-67e133f2f648 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:06.746663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:06.747373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:06.747643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:06.747900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:06.816521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:06.825781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:06.827440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:06.944390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 613/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:48:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:48:06.950457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:06.984288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:07.076794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb101-a130-49f5-9e49-93ecd110c3fd None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:07.123463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:07.124431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:07.124836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:07.125116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:07.136858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:07.138795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:07.157228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:07.158298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:07.159207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:07.159207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:07.159207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:07.159207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 629/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:07.165202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:07.279672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:07.286828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94070338-5e78-4f8a-afa4-bc257e91de89 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:07.328413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:07.328934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:07.329502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:07.329781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:07.330423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:07.330728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:07.332158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:07.344589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 614/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:07.351004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:07.438259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:07.463047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed32467-d8f3-4600-b95f-d435eab150b1 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:07.503473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:07.504107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:07.504381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:07.504648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:07.511603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:07.513031 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:48:07.525065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:07.526353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:07.527396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 630/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:07.532107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:07.639363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd72a3b-1cbc-4f8b-b3cd-0b19b8c1a050 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:07.680175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703906c9-63b9-4630-a3fc-31d31a408db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:07.680773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703906c9-63b9-4630-a3fc-31d31a408db6 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:07.681044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703906c9-63b9-4630-a3fc-31d31a408db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:07.681314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703906c9-63b9-4630-a3fc-31d31a408db6 None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:07.682035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703906c9-63b9-4630-a3fc-31d31a408db6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:07.682791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703906c9-63b9-4630-a3fc-31d31a408db6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:07.684202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703906c9-63b9-4630-a3fc-31d31a408db6 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:07.697213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 615/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:07.702720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:07.826904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb589e-df9c-4fdb-b562-60d5bd11ebe0 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:07.864687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb1a71-ba2c-4612-9e3c-32c48c45c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:07.865360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb1a71-ba2c-4612-9e3c-32c48c45c38a None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:07.865646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb1a71-ba2c-4612-9e3c-32c48c45c38a None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:07.866018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb1a71-ba2c-4612-9e3c-32c48c45c38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:07.866997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb1a71-ba2c-4612-9e3c-32c48c45c38a None admin] RBAC: Adding query filter params (role.id=6829f18de75049389086cb4eccc75948, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=ef370b70e8194df9a52c26e21c375730) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:07.867413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb1a71-ba2c-4612-9e3c-32c48c45c38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:07.869330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb1a71-ba2c-4612-9e3c-32c48c45c38a None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:07.886136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 631/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:48:07 2022] GET /identity/v3/role_assignments?user.id=ef370b70e8194df9a52c26e21c375730&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=6829f18de75049389086cb4eccc75948 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:10.418096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684ab0-ca72-470f-9b3c-528fcedd7445 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:10.418864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684ab0-ca72-470f-9b3c-528fcedd7445 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:10.418864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6684ab0-ca72-470f-9b3c-528fcedd7445 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:10.420794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 616/1247] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:48:10.427747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867259-b467-4e86-9065-4b55aeba3b16 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:10.428157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867259-b467-4e86-9065-4b55aeba3b16 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:10.428306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867259-b467-4e86-9065-4b55aeba3b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:10.435882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:10.452249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-30867259-b467-4e86-9065-4b55aeba3b16 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:10.453635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-30867259-b467-4e86-9065-4b55aeba3b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:10.530540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 632/1248] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:10.831564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684ab0-ca72-470f-9b3c-528fcedd7445 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:10.853561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:10.948770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6684ab0-ca72-470f-9b3c-528fcedd7445 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:10.987365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:10.987931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:10.988201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:10.988549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:10.998974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:48:11.003725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:11.005378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:11.006267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 617/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:11.011190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867259-b467-4e86-9065-4b55aeba3b16 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:11.135370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867259-b467-4e86-9065-4b55aeba3b16 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:11.173549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:11.180043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:11.180745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:11.181018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:11.181316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:11.182203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:11.182529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:11.184046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:11.193595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 633/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:11.199556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:11.290079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:11.317222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d63a2-8072-43dc-9515-cc966a3a3c2e None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:11.354236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:11.354886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:11.355159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:11.355426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:11.368843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:11.370405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:11.386455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:11.387613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:11.388945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:11.388945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:11.388945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:11.388945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 618/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 14:48:11.393733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:11.499826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca780f9-91bd-460a-b695-d7c07c211860 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:11.536775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:11.537392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:11.537674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:11.537948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:11.538648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:11.538956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:11.540407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:11.553919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 634/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:11.559728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:11.664986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25d422-4766-450b-b545-7e5ad61dc7d6 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:11.694098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:11.702619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:11.703265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:11.703537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:11.703802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:11.712700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:11.714173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:48:11.726497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:11.727769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:11.729003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 619/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:11.734396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:11.792538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:11.839258 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcaefd-2991-49ae-b294-5c81d1c816bf None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:11.873598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:11.874283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:11.874559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:11.874861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:11.875591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:11.875896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:11.877335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:11.895371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 635/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Sep 9 14:48:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:11.900914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:12.006586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db917d-1e64-42b9-9f92-e51a50d41026 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:12.038997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:12.039595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:12.039867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:12.040133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:12.100867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:12.113108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:12.114790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:12.209624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 620/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:48:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:48:12.215465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:12.312033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc7333-7f8a-451d-be13-fc4a354fe7f2 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:12.325361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:12.346247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:12.346861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:12.347138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:12.347407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:12.357309 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:12.358731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:12.373377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:12.374524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:12.375523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:12.375523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:12.375523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:12.375523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 636/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:12.380873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:12.465474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:12.477705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c1c0e-a7ef-46e4-bba7-4929dc1821ca None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:12.510868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:12.511457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:12.511730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:12.511995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:12.512618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:12.512911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:12.514280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:12.525025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 621/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:12.530699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:12.628295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5ce58-6ec3-4236-81fb-016167ab8caa None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:12.660536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:12.661143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:12.661419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:12.661687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:12.668071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:12.669496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:48:12.682119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:12.683041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:12.683947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 637/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:12.689122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:12.786961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b148b-4d47-49f1-9a68-256067498e11 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:12.819372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931f2a-e327-4757-a7a6-4ab249bfac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:12.819968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931f2a-e327-4757-a7a6-4ab249bfac4c None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:12.820245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931f2a-e327-4757-a7a6-4ab249bfac4c None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:12.820514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931f2a-e327-4757-a7a6-4ab249bfac4c None admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:12.821188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60931f2a-e327-4757-a7a6-4ab249bfac4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:12.821493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60931f2a-e327-4757-a7a6-4ab249bfac4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:12.822926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60931f2a-e327-4757-a7a6-4ab249bfac4c None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:12.834789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 622/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:12.840895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:12.866947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:12.940111 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c672214-86a5-4866-89e9-f6a70b0a3d9b None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:12.972177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd6d56-9226-4087-aaf1-e2d72b42f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:12.973271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6d56-9226-4087-aaf1-e2d72b42f80e None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:12.973708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6d56-9226-4087-aaf1-e2d72b42f80e None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:12.974058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd6d56-9226-4087-aaf1-e2d72b42f80e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:12.974805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6d56-9226-4087-aaf1-e2d72b42f80e None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=ef370b70e8194df9a52c26e21c375730) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:12.975112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6d56-9226-4087-aaf1-e2d72b42f80e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:12.976530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd6d56-9226-4087-aaf1-e2d72b42f80e None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:12.981761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 638/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:48:12 2022] GET /identity/v3/role_assignments?user.id=ef370b70e8194df9a52c26e21c375730&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:15.124822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970d638-ba04-461b-8703-35697ec2417e None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:15.125374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970d638-ba04-461b-8703-35697ec2417e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:15.125374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970d638-ba04-461b-8703-35697ec2417e None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:15.126666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 623/1261] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:48:15.133134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346fc2-9da0-46a4-ad12-8a0189880cff None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:15.133619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346fc2-9da0-46a4-ad12-8a0189880cff None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:15.133763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346fc2-9da0-46a4-ad12-8a0189880cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:15.153771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-eb346fc2-9da0-46a4-ad12-8a0189880cff None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:15.155033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-eb346fc2-9da0-46a4-ad12-8a0189880cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:15.219806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 639/1262] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:15.489024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970d638-ba04-461b-8703-35697ec2417e None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:15.500344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:15.588512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970d638-ba04-461b-8703-35697ec2417e None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:15.621209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:15.621821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:15.622109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:15.622388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:15.632647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:48:15.637268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:15.638390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:15.639485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 624/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:15.644309 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346fc2-9da0-46a4-ad12-8a0189880cff None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:15.661967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:15.747197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346fc2-9da0-46a4-ad12-8a0189880cff None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:15.779426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:15.780022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:15.780304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:15.780580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:15.781243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:15.781624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:15.783103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:15.792068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 640/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:15.797943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:15.864143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:15.896237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100614b0-e1f9-43fd-a9fe-55d481c89475 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:15.929206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:15.929813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:15.930187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:15.930462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:15.939984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:15.941447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:15.956436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:15.957581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:15.958745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:15.958745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:15.958745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:15.958745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 625/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:15.963610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:16.043030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:16.064559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84682ba4-46d9-421e-abe2-2839c34fc445 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:16.102794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:16.103394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:16.103672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:16.103941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:16.104566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:16.104865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:16.106260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:16.117703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 641/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:16.123378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:16.218726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4da2a-ac06-495e-a981-b10419d6b6ef None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:16.237725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:16.251651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:16.252266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:16.252539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:16.252805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:16.260190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:16.261592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:48:16.272858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:16.273980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:16.275194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 626/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:16.280001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:16.378656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b81a3-56eb-4dc8-bb3e-99b38384fde5 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:16.412372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:16.412963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:16.413243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:16.413513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:16.414262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:16.414569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:16.415975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:16.424343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:16.433587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 642/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Sep 9 14:48:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:16.439317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:16.538851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f0da-274e-4509-a69d-76b7f6081a1f None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:16.571745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:16.572377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:16.572643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:16.572915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:16.584274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:16.585716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:16.599724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:16.600737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:16.601699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:16.601699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:16.601699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:16.601699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 627/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:16.606455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:16.702374 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90450-7378-40ea-97be-ac6bb932d965 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:16.735493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:16.736081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:16.736354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:16.736619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:16.737241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:16.737537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:16.739008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:16.749660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 643/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:16.756035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:16.787108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:16.853827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437512-bece-46f6-8cf9-119d5390b681 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:16.886770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:16.887381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:16.887662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:16.887935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:16.894298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:16.895975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:48:16.906936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:16.907944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:16.908947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 628/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:16.913893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:16.972054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:17.015771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafd81e-5a0c-4331-87a3-5c735c77c5f3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:17.048411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce22c2c-ac19-4c99-8042-7466562270ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:17.049008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce22c2c-ac19-4c99-8042-7466562270ca None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:17.049290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce22c2c-ac19-4c99-8042-7466562270ca None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:17.049564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce22c2c-ac19-4c99-8042-7466562270ca None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:17.050276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce22c2c-ac19-4c99-8042-7466562270ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:17.050585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce22c2c-ac19-4c99-8042-7466562270ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:17.053045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce22c2c-ac19-4c99-8042-7466562270ca None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:17.065909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 644/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:17.072473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:17.161560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:17.170404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88300d1-72a3-4f7b-abd4-0ba73391b6d5 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:17.203246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ae4d3-bc27-4e68-8635-573a7b9c9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:17.204133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ae4d3-bc27-4e68-8635-573a7b9c9792 None admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:17.204407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ae4d3-bc27-4e68-8635-573a7b9c9792 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:17.204671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ae4d3-bc27-4e68-8635-573a7b9c9792 None admin] PATH_INFO: `/v3/projects/4f0ad2f54a4740899704352ca291354c/users/ef370b70e8194df9a52c26e21c375730/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:17.206599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ae4d3-bc27-4e68-8635-573a7b9c9792 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0ad2f54a4740899704352ca291354c, user_id=ef370b70e8194df9a52c26e21c375730, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:17.207994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ae4d3-bc27-4e68-8635-573a7b9c9792 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:17.219656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 629/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Sep 9 14:48:17 2022] PUT /identity/v3/projects/4f0ad2f54a4740899704352ca291354c/users/ef370b70e8194df9a52c26e21c375730/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:48:19.324151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ddff-14ce-4625-897e-2c84709764ff None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:19.324678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ddff-14ce-4625-897e-2c84709764ff None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:19.324678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223ddff-14ce-4625-897e-2c84709764ff None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:19.326036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 645/1274] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:48:19.331354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d61d-0511-48f4-b0ab-88c18a1034af None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:19.332286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d61d-0511-48f4-b0ab-88c18a1034af None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:19.332428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63d61d-0511-48f4-b0ab-88c18a1034af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:19.351303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ca63d61d-0511-48f4-b0ab-88c18a1034af None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:19.352464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ca63d61d-0511-48f4-b0ab-88c18a1034af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:19.415935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 630/1275] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:19.681918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223ddff-14ce-4625-897e-2c84709764ff None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:19.782322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223ddff-14ce-4625-897e-2c84709764ff None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:19.798959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:19.815842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:19.817060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:19.817333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:19.817602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:19.827388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 14:48:19.832619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:19.833704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:19.834750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 646/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Sep 9 14:48:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:19.839674 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d61d-0511-48f4-b0ab-88c18a1034af None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:19.917776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:19.935914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63d61d-0511-48f4-b0ab-88c18a1034af None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:19.968491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:19.969079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:19.969354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:19.969621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:19.970302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:19.970599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:19.971935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:19.980242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 631/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Sep 9 14:48:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:19.986142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:20.089476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d6131-6c44-4895-80bb-421d46d7d801 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:20.127117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:20.127814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:20.128136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:20.128411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:20.138252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:20.139695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:20.154584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:20.155751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:20.156891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:20.156891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:20.156891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:20.156891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 647/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:20.162219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:20.258465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43d8b5-d436-4164-80ef-5b436971e0d1 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:20.291855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:20.292450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:20.292725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:20.292994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:20.293629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:20.293926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:20.295295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:20.306762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 632/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:20.312340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:20.344527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:20.412341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775af9-c58c-40a5-8d19-9c6e97de44d7 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:20.445063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:20.445676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:20.445954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:20.446253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:20.453360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:20.455072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 14:48:20.466035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:20.467168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:20.468485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 648/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:20.473465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:20.477247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:20.570555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989e0ae-720f-4e54-8b99-172a29a4f2f9 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:20.604818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:20.605412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:20.605691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:20.605961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:20.606725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:20.607029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:20.608431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:20.624982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 633/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Sep 9 14:48:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:20.630834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:20.720394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:20.731355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd88eae-df36-43c5-8945-21ce8cf8f3f6 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:20.763897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:20.764481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:20.764757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:20.765022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:20.831179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:20.833549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:20.919463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:20.930401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 649/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Sep 9 14:48:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 14:48:20.936168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:20.995186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:21.032558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656eb57e-a67c-4958-b40c-922488f36668 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:21.065153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:21.065773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:21.066589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:21.066860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:21.076593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:21.078022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 14:48:21.093772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:21.094888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 14:48:21.095772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 14:48:21.095772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 14:48:21.095772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:21.095772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 634/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:21.100583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:21.196009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3749e-7027-4002-8106-b10e3075fdc3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:21.229051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:21.229630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:21.229903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:21.230280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:21.230912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:21.231209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:21.232557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:21.243227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 650/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Sep 9 14:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:21.248760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:21.345647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dcd2c-1714-47cd-8f48-902424f423cb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:21.358610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:21.379297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:21.380008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:21.380288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:21.380560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:21.386880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:21.388295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 14:48:21.399209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:21.400234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: ERROR keystone.server.flask.application Sep 09 14:48:21.401524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 635/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Sep 9 14:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:21.406067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:21.454743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:21.502605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc753dce-b499-4495-a6ae-d16874258afb None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:21.534832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d5605-21da-4f07-8821-2110616d198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:21.535543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5605-21da-4f07-8821-2110616d198f None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:21.535818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5605-21da-4f07-8821-2110616d198f None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:21.536087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d5605-21da-4f07-8821-2110616d198f None admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:21.536759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d5605-21da-4f07-8821-2110616d198f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:21.537058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d5605-21da-4f07-8821-2110616d198f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:21.538490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d5605-21da-4f07-8821-2110616d198f None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:21.551157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 651/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Sep 9 14:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:21.557104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:21.653783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b136c-6108-439d-9851-e588186c3603 None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:21.686378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd2aa8-7a2a-489c-b098-a337afd14432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:21.686972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2aa8-7a2a-489c-b098-a337afd14432 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:21.687252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2aa8-7a2a-489c-b098-a337afd14432 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:21.687523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd2aa8-7a2a-489c-b098-a337afd14432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:21.688236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd2aa8-7a2a-489c-b098-a337afd14432 None admin] RBAC: Adding query filter params (role.id=129e9ce3dddb438da251c372b5c90f63, scope.project.id=4f0ad2f54a4740899704352ca291354c, user.id=ef370b70e8194df9a52c26e21c375730) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:21.688540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd2aa8-7a2a-489c-b098-a337afd14432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:21.689950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd2aa8-7a2a-489c-b098-a337afd14432 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:21.696306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 636/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Sep 9 14:48:21 2022] GET /identity/v3/role_assignments?user.id=ef370b70e8194df9a52c26e21c375730&scope.project.id=4f0ad2f54a4740899704352ca291354c&role.id=129e9ce3dddb438da251c372b5c90f63 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:23.830964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10727-b575-42c2-9c6f-6f83b296a61a None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:23.831973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10727-b575-42c2-9c6f-6f83b296a61a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:23.832093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe10727-b575-42c2-9c6f-6f83b296a61a None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:23.833397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 652/1288] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:48:23.838649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd8bba-dfee-4edd-b6cf-26cc154ac7b8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:23.839046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd8bba-dfee-4edd-b6cf-26cc154ac7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:23.839192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd8bba-dfee-4edd-b6cf-26cc154ac7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:23.857346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7bfd8bba-dfee-4edd-b6cf-26cc154ac7b8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:23.858542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7bfd8bba-dfee-4edd-b6cf-26cc154ac7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:23.886356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:23.922806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 637/1289] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:24.227043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10727-b575-42c2-9c6f-6f83b296a61a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:24.328149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe10727-b575-42c2-9c6f-6f83b296a61a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:24.339874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:24.363925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:24.364545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:24.364820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:24.365087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:24.365658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:24.367026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:24.375405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:24.376584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:24.377776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 653/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:48:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:24.383290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd8bba-dfee-4edd-b6cf-26cc154ac7b8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:24.478174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd8bba-dfee-4edd-b6cf-26cc154ac7b8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:24.511136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08518c76-f0db-4af2-91f2-22fcc5540187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:24.511725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518c76-f0db-4af2-91f2-22fcc5540187 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:24.512002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518c76-f0db-4af2-91f2-22fcc5540187 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:24.512272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08518c76-f0db-4af2-91f2-22fcc5540187 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:24.512893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08518c76-f0db-4af2-91f2-22fcc5540187 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:24.513194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08518c76-f0db-4af2-91f2-22fcc5540187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:24.514572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08518c76-f0db-4af2-91f2-22fcc5540187 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:24.519391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 638/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Sep 9 14:48:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:24.524984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:24.623125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b49eb8-913b-405f-b9b1-9c0dd3c0344c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:24.655944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13835e-9792-40f7-a618-04c791b38eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:24.656536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13835e-9792-40f7-a618-04c791b38eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:24.656816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13835e-9792-40f7-a618-04c791b38eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:24.657087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13835e-9792-40f7-a618-04c791b38eb9 None admin] PATH_INFO: `/v3/services` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:24.657699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13835e-9792-40f7-a618-04c791b38eb9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:24.658001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13835e-9792-40f7-a618-04c791b38eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:24.659398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13835e-9792-40f7-a618-04c791b38eb9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:24.663760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 654/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Sep 9 14:48:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:26.782815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09ecd4-5e27-410b-9428-926d9ca982d7 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:26.783323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09ecd4-5e27-410b-9428-926d9ca982d7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:26.783415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09ecd4-5e27-410b-9428-926d9ca982d7 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:26.784883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 639/1293] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:48:26.790574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cfad0-edd3-414b-ba30-747d4683c847 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:26.790997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cfad0-edd3-414b-ba30-747d4683c847 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:26.791115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cfad0-edd3-414b-ba30-747d4683c847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:26.808828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1c2cfad0-edd3-414b-ba30-747d4683c847 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:26.810001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1c2cfad0-edd3-414b-ba30-747d4683c847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:26.838957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:26.875557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 655/1294] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:27.146608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09ecd4-5e27-410b-9428-926d9ca982d7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:27.176930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:27.246182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09ecd4-5e27-410b-9428-926d9ca982d7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:27.279879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104736d-9ad8-40ae-becb-c6ea7c6399d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:27.280476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104736d-9ad8-40ae-becb-c6ea7c6399d0 None admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:27.280752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104736d-9ad8-40ae-becb-c6ea7c6399d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:27.281022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104736d-9ad8-40ae-becb-c6ea7c6399d0 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:27.281671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104736d-9ad8-40ae-becb-c6ea7c6399d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:27.283058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104736d-9ad8-40ae-becb-c6ea7c6399d0 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:27.297178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 640/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Sep 9 14:48:27 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:48:29.568104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a957-fa7a-40c2-a97e-64aa3cf70c97 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:29.568629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a957-fa7a-40c2-a97e-64aa3cf70c97 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:29.568629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a957-fa7a-40c2-a97e-64aa3cf70c97 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:29.569962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 656/1296] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:48:29.575201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e960-5475-4e62-bfcd-89d990937f2b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:29.575650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e960-5475-4e62-bfcd-89d990937f2b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:29.575754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351e960-5475-4e62-bfcd-89d990937f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:29.594793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e351e960-5475-4e62-bfcd-89d990937f2b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:29.595952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e351e960-5475-4e62-bfcd-89d990937f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:29.665432 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 641/1297] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:29.933813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a957-fa7a-40c2-a97e-64aa3cf70c97 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:30.035114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a957-fa7a-40c2-a97e-64aa3cf70c97 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:30.071757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:30.072568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:30.073100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:30.073615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:30.074466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:30.076139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:30.087901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:30.088984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:30.090213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 657/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:48:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:30.096727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351e960-5475-4e62-bfcd-89d990937f2b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:30.120483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:30.203806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351e960-5475-4e62-bfcd-89d990937f2b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:30.235968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:30.236560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:30.236830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:30.237093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:30.237867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:30.238225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:30.239567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:30.244468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 642/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Sep 9 14:48:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:30.250508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:30.282496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:30.351152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972896a-7ec3-47fb-8ab2-350233271bd3 None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:30.384770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f34aac-9bc1-4580-99e1-61033b7c39a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:30.385371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f34aac-9bc1-4580-99e1-61033b7c39a9 None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:30.385650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f34aac-9bc1-4580-99e1-61033b7c39a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:30.385924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f34aac-9bc1-4580-99e1-61033b7c39a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:30.386645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f34aac-9bc1-4580-99e1-61033b7c39a9 None admin] RBAC: Adding query filter params (interface=public, service_id=f16465f5845c46eead362bb797bc4bfc, region_id=RegionOne) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:30.386957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f34aac-9bc1-4580-99e1-61033b7c39a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:30.388321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f34aac-9bc1-4580-99e1-61033b7c39a9 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:30.393236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 658/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Sep 9 14:48:30 2022] GET /identity/v3/endpoints?service_id=f16465f5845c46eead362bb797bc4bfc&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:30.399133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:30.479228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:30.496904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b88238-9d1c-4190-82cb-9c358187fbeb None admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:30.530064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae06445-42b3-45c9-ad38-11622f9faa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:30.530686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae06445-42b3-45c9-ad38-11622f9faa6a None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:30.530966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae06445-42b3-45c9-ad38-11622f9faa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:30.531239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae06445-42b3-45c9-ad38-11622f9faa6a None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:30.531835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae06445-42b3-45c9-ad38-11622f9faa6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:30.533182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae06445-42b3-45c9-ad38-11622f9faa6a None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:30.540410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 643/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Sep 9 14:48:30 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:48:32.641080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9faa5-5dab-432c-9e12-ca2334f3ed07 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:32.641608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9faa5-5dab-432c-9e12-ca2334f3ed07 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:32.641608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9faa5-5dab-432c-9e12-ca2334f3ed07 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:32.642987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 659/1302] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:48:32.649244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73718c8-c9b9-4ca3-9cd1-cb16c8d4fd32 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:32.649657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73718c8-c9b9-4ca3-9cd1-cb16c8d4fd32 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:32.649786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73718c8-c9b9-4ca3-9cd1-cb16c8d4fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:32.668340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b73718c8-c9b9-4ca3-9cd1-cb16c8d4fd32 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:48:32.669498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b73718c8-c9b9-4ca3-9cd1-cb16c8d4fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:48:32.735007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 644/1303] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:48:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 14:48:33.007779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9faa5-5dab-432c-9e12-ca2334f3ed07 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:33.114742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:33.121906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9faa5-5dab-432c-9e12-ca2334f3ed07 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:33.155256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:33.155868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:33.156142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:33.156406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:33.156975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:33.158347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 14:48:33.166976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 14:48:33.168131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application with Lock( Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self._enter() Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application return self.creator() Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application created_value = creator( Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: ERROR keystone.server.flask.application Sep 09 14:48:33.169165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 660/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Sep 9 14:48:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 14:48:33.173986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73718c8-c9b9-4ca3-9cd1-cb16c8d4fd32 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:33.247234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:33.271258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73718c8-c9b9-4ca3-9cd1-cb16c8d4fd32 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:33.303585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27433527-b1df-4966-995b-467929ede478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:33.304174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433527-b1df-4966-995b-467929ede478 None admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:33.304447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433527-b1df-4966-995b-467929ede478 None admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:33.304712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433527-b1df-4966-995b-467929ede478 None admin] PATH_INFO: `/v3/services` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:33.305327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27433527-b1df-4966-995b-467929ede478 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:48:33.305623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27433527-b1df-4966-995b-467929ede478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:33.306982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27433527-b1df-4966-995b-467929ede478 None admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:33.311831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 645/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Sep 9 14:48:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:48:33.318044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:48:33.415246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264f39b-c859-4b4a-a98e-f1a991036b6c None admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:48:33.448644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2900066-347d-4407-9c26-5e36bbc45e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:48:33.449234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900066-347d-4407-9c26-5e36bbc45e01 None admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:48:33.449510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900066-347d-4407-9c26-5e36bbc45e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:48:33.449780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2900066-347d-4407-9c26-5e36bbc45e01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:48:33.450469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2900066-347d-4407-9c26-5e36bbc45e01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:48:33.451816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2900066-347d-4407-9c26-5e36bbc45e01 None admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:48:33.470663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 661/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:48:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:48:43.309142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=30 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:48:43.466495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:37.027118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928117-8a93-415d-9684-1264e07e408c None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:37.027836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928117-8a93-415d-9684-1264e07e408c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:37.027836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c928117-8a93-415d-9684-1264e07e408c None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:37.034242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 646/1307] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:49:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:37.035315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb37fab-9c36-42f9-ae1f-9b305731af68 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:37.035792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb37fab-9c36-42f9-ae1f-9b305731af68 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:37.035879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb37fab-9c36-42f9-ae1f-9b305731af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:37.122774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5fb37fab-9c36-42f9-ae1f-9b305731af68 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:37.123974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5fb37fab-9c36-42f9-ae1f-9b305731af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:37.242803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 662/1308] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:37.570140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471d951-030e-490b-98a5-919a6b917d3c None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:37.570418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471d951-030e-490b-98a5-919a6b917d3c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:37.570695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471d951-030e-490b-98a5-919a6b917d3c None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:37.572073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 647/1309] 10.222.0.52 () {54 vars in 965 bytes} [Fri Sep 9 14:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:37.580399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf6db-2578-4523-a8a2-a070023b1187 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:37.580687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf6db-2578-4523-a8a2-a070023b1187 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:37.580961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bf6db-2578-4523-a8a2-a070023b1187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:37.667223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-665bf6db-2578-4523-a8a2-a070023b1187 None None] MFA Rules not processed for user `b7a92823ec184a86a8ce70ffa1a4424b`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:37.668411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-665bf6db-2578-4523-a8a2-a070023b1187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:37.707271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:37.772712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 663/1310] 10.222.0.52 () {58 vars in 1062 bytes} [Fri Sep 9 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:37.782561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471d951-030e-490b-98a5-919a6b917d3c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:49:37.784938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1471d951-030e-490b-98a5-919a6b917d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:37.918852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471d951-030e-490b-98a5-919a6b917d3c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:49:38.007021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f969ae-7f4b-4506-93ca-89756ecb47a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:49:38.007727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f969ae-7f4b-4506-93ca-89756ecb47a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:38.008045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f969ae-7f4b-4506-93ca-89756ecb47a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:38.008231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f969ae-7f4b-4506-93ca-89756ecb47a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:38.010891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f7f969ae-7f4b-4506-93ca-89756ecb47a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:38.070294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:38.130956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f969ae-7f4b-4506-93ca-89756ecb47a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:49:38.132281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f969ae-7f4b-4506-93ca-89756ecb47a7 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:49:38.154573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 648/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:49:40.645448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a78067-c0d8-4fca-ae2b-35915f39b59b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:40.646023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a78067-c0d8-4fca-ae2b-35915f39b59b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:40.646023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a78067-c0d8-4fca-ae2b-35915f39b59b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:40.647335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 664/1312] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:40.652720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bd909-9435-4899-ac3b-2579b2e89866 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:40.653143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bd909-9435-4899-ac3b-2579b2e89866 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:40.653274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bd909-9435-4899-ac3b-2579b2e89866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:40.740990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9a2bd909-9435-4899-ac3b-2579b2e89866 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:40.742227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9a2bd909-9435-4899-ac3b-2579b2e89866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:40.840834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 649/1313] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:41.129211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a78067-c0d8-4fca-ae2b-35915f39b59b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:49:41.130878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-60a78067-c0d8-4fca-ae2b-35915f39b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:41.237830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a78067-c0d8-4fca-ae2b-35915f39b59b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:49:41.311830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:41.315063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271777-3441-4999-b473-b53a04076c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:49:41.315853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271777-3441-4999-b473-b53a04076c82 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:41.316354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271777-3441-4999-b473-b53a04076c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:41.316802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271777-3441-4999-b473-b53a04076c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:41.318564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-73271777-3441-4999-b473-b53a04076c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:41.430398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271777-3441-4999-b473-b53a04076c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:49:41.432012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271777-3441-4999-b473-b53a04076c82 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:49:41.449988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 665/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:49:43.922223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e2ff-5901-47c5-b085-11ac6ccb3895 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:43.922753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e2ff-5901-47c5-b085-11ac6ccb3895 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:43.922753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e2ff-5901-47c5-b085-11ac6ccb3895 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:43.924113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 650/1315] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:43.929420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10ce1a-d73c-4425-aab6-11f9866d165f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:43.929840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10ce1a-d73c-4425-aab6-11f9866d165f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:43.929954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10ce1a-d73c-4425-aab6-11f9866d165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:43.996640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1c10ce1a-d73c-4425-aab6-11f9866d165f None None] MFA Rules not processed for user `2cc4eaf91022454889475c0da5fbc647`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:43.997778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1c10ce1a-d73c-4425-aab6-11f9866d165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:44.050069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:44.094886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 666/1316] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:49:44.380582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7e2ff-5901-47c5-b085-11ac6ccb3895 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:49:44.382163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d3f7e2ff-5901-47c5-b085-11ac6ccb3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:44.391828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:44.486022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7e2ff-5901-47c5-b085-11ac6ccb3895 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:49:44.558012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca5396-fa48-4c25-a4c3-2beefa05c10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:49:44.558636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5396-fa48-4c25-a4c3-2beefa05c10d service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:44.558914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5396-fa48-4c25-a4c3-2beefa05c10d service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:44.559186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca5396-fa48-4c25-a4c3-2beefa05c10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:44.560780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8fca5396-fa48-4c25-a4c3-2beefa05c10d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:44.621408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:44.669212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca5396-fa48-4c25-a4c3-2beefa05c10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:49:44.670687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca5396-fa48-4c25-a4c3-2beefa05c10d service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:49:44.688591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 651/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:49:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:49:47.357772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b2dc4-a1a1-4a5a-9ddd-fb2de2974905 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:47.358370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b2dc4-a1a1-4a5a-9ddd-fb2de2974905 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:47.358370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b2dc4-a1a1-4a5a-9ddd-fb2de2974905 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:47.360515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 667/1318] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:47.365717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f917-7612-463b-b3bf-9cdfb0d4dc63 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:47.366125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f917-7612-463b-b3bf-9cdfb0d4dc63 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:47.366295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f917-7612-463b-b3bf-9cdfb0d4dc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:47.430578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-94a4f917-7612-463b-b3bf-9cdfb0d4dc63 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:47.431786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-94a4f917-7612-463b-b3bf-9cdfb0d4dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:47.526440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 652/1319] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:47.809802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b2dc4-a1a1-4a5a-9ddd-fb2de2974905 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:49:47.811395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8d9b2dc4-a1a1-4a5a-9ddd-fb2de2974905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:47.915005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b2dc4-a1a1-4a5a-9ddd-fb2de2974905 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:49:47.986874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aecf6-a4df-4a9b-b75b-05250bf80560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:49:47.987391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aecf6-a4df-4a9b-b75b-05250bf80560 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:47.987666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aecf6-a4df-4a9b-b75b-05250bf80560 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:47.987934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aecf6-a4df-4a9b-b75b-05250bf80560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:47.989501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-113aecf6-a4df-4a9b-b75b-05250bf80560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:47.996204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:48.098766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aecf6-a4df-4a9b-b75b-05250bf80560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:49:48.100202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aecf6-a4df-4a9b-b75b-05250bf80560 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:49:48.117752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 668/1320] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:49:50.910836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55957bb-1007-4c79-a201-618b18d83a53 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:50.911394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55957bb-1007-4c79-a201-618b18d83a53 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:50.911394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55957bb-1007-4c79-a201-618b18d83a53 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:50.912724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 653/1321] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:50.917874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8421f3-fc9d-46bc-8f3e-d2a7cdce9036 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:50.918328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8421f3-fc9d-46bc-8f3e-d2a7cdce9036 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:50.918444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8421f3-fc9d-46bc-8f3e-d2a7cdce9036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:50.992967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3c8421f3-fc9d-46bc-8f3e-d2a7cdce9036 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:50.994133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3c8421f3-fc9d-46bc-8f3e-d2a7cdce9036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:51.056775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:51.101540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 669/1322] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:51.385129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55957bb-1007-4c79-a201-618b18d83a53 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:49:51.386784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d55957bb-1007-4c79-a201-618b18d83a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:51.408477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:51.491903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55957bb-1007-4c79-a201-618b18d83a53 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:49:51.565799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c099a-0b0e-41dd-85eb-e061d4a46a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:49:51.566428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c099a-0b0e-41dd-85eb-e061d4a46a2e service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:51.566708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c099a-0b0e-41dd-85eb-e061d4a46a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:51.566978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c099a-0b0e-41dd-85eb-e061d4a46a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:51.568573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e28c099a-0b0e-41dd-85eb-e061d4a46a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:51.642374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:51.681521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c099a-0b0e-41dd-85eb-e061d4a46a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:49:51.682989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c099a-0b0e-41dd-85eb-e061d4a46a2e service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:49:51.705471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 654/1323] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:49:53.941967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee864d8-83cb-49b0-a14f-52848afa019b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:53.942520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee864d8-83cb-49b0-a14f-52848afa019b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:53.942520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee864d8-83cb-49b0-a14f-52848afa019b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:53.943865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 670/1324] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:53.949145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9ab2-fece-4442-a8a6-6a1734a3efa3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:53.949554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9ab2-fece-4442-a8a6-6a1734a3efa3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:53.949680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa9ab2-fece-4442-a8a6-6a1734a3efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:54.016610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8eaa9ab2-fece-4442-a8a6-6a1734a3efa3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:54.018250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8eaa9ab2-fece-4442-a8a6-6a1734a3efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:54.131314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 655/1325] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:54.439724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe83d-54c0-4b2a-8f56-e8a67c6af5e2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:54.440090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe83d-54c0-4b2a-8f56-e8a67c6af5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:54.440428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe83d-54c0-4b2a-8f56-e8a67c6af5e2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:54.441856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 671/1326] 10.222.0.52 () {54 vars in 965 bytes} [Fri Sep 9 14:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:54.448010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aade5-685e-4f70-93de-fee8caaf3174 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:54.448300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aade5-685e-4f70-93de-fee8caaf3174 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:54.448576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aade5-685e-4f70-93de-fee8caaf3174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:54.480227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:54.527034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-827aade5-685e-4f70-93de-fee8caaf3174 None None] MFA Rules not processed for user `b7a92823ec184a86a8ce70ffa1a4424b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:54.528229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-827aade5-685e-4f70-93de-fee8caaf3174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:54.603188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 656/1327] 10.222.0.52 () {58 vars in 1062 bytes} [Fri Sep 9 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:54.612780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe83d-54c0-4b2a-8f56-e8a67c6af5e2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:49:54.614358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-140fe83d-54c0-4b2a-8f56-e8a67c6af5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:54.724539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe83d-54c0-4b2a-8f56-e8a67c6af5e2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:49:54.799288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a604-aee8-4be2-bb04-8a4541533bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:49:54.799896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a604-aee8-4be2-bb04-8a4541533bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:54.800174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a604-aee8-4be2-bb04-8a4541533bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:54.800452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a604-aee8-4be2-bb04-8a4541533bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:54.802046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9167a604-aee8-4be2-bb04-8a4541533bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:54.819025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:54.910587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a604-aee8-4be2-bb04-8a4541533bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:49:54.912021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a604-aee8-4be2-bb04-8a4541533bf4 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:49:54.930744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 672/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:49:57.353257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f506db-1b74-4bd3-b939-4cd56e344636 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:57.353741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f506db-1b74-4bd3-b939-4cd56e344636 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:57.353843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f506db-1b74-4bd3-b939-4cd56e344636 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:57.355361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 657/1329] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:49:57.361164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e422-3d41-4f2f-8639-68fbb3800882 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:57.361640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e422-3d41-4f2f-8639-68fbb3800882 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:57.361734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e422-3d41-4f2f-8639-68fbb3800882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:57.431487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b2d6e422-3d41-4f2f-8639-68fbb3800882 None None] MFA Rules not processed for user `2cc4eaf91022454889475c0da5fbc647`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:49:57.432710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b2d6e422-3d41-4f2f-8639-68fbb3800882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:57.501378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:57.533334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 673/1330] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:49:57.817039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f506db-1b74-4bd3-b939-4cd56e344636 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:49:57.818697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a9f506db-1b74-4bd3-b939-4cd56e344636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:57.924215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f506db-1b74-4bd3-b939-4cd56e344636 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:49:57.946206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:49:58.001927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48998e-9b72-4ade-beb5-7ddef31f20de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:49:58.002559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48998e-9b72-4ade-beb5-7ddef31f20de service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:49:58.002834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48998e-9b72-4ade-beb5-7ddef31f20de service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:49:58.003098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48998e-9b72-4ade-beb5-7ddef31f20de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:49:58.004700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8e48998e-9b72-4ade-beb5-7ddef31f20de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:49:58.118505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48998e-9b72-4ade-beb5-7ddef31f20de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:49:58.119981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48998e-9b72-4ade-beb5-7ddef31f20de service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:49:58.138314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 658/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:00.710814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acc623-cd81-4bf6-9ea4-943f150f1e12 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:00.711259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acc623-cd81-4bf6-9ea4-943f150f1e12 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:00.711399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acc623-cd81-4bf6-9ea4-943f150f1e12 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:00.712774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 674/1332] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:00.717917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ac57-999c-48be-96bf-ec6e0b1664ea None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:00.718348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ac57-999c-48be-96bf-ec6e0b1664ea None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:00.718496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ac57-999c-48be-96bf-ec6e0b1664ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:00.781971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:00.785081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2310ac57-999c-48be-96bf-ec6e0b1664ea None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:00.786889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2310ac57-999c-48be-96bf-ec6e0b1664ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:00.883621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 659/1333] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:01.169345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acc623-cd81-4bf6-9ea4-943f150f1e12 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:01.171450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a2acc623-cd81-4bf6-9ea4-943f150f1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:01.274933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acc623-cd81-4bf6-9ea4-943f150f1e12 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:01.347978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ad8e-c646-4d15-a801-262865e43824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:01.348580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ad8e-c646-4d15-a801-262865e43824 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:01.348836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ad8e-c646-4d15-a801-262865e43824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:01.349100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ad8e-c646-4d15-a801-262865e43824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:01.350692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ac85ad8e-c646-4d15-a801-262865e43824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:01.378368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:01.459448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ad8e-c646-4d15-a801-262865e43824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:01.460785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ad8e-c646-4d15-a801-262865e43824 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:01.479009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 675/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:03.677618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329f99-7de7-44de-8245-d50059d1f483 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:03.678184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329f99-7de7-44de-8245-d50059d1f483 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:03.678334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00329f99-7de7-44de-8245-d50059d1f483 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:03.679555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 660/1335] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:03.684695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83b956-0f5c-4ec1-9a5e-f34df9172b3e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:03.685138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83b956-0f5c-4ec1-9a5e-f34df9172b3e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:03.685233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83b956-0f5c-4ec1-9a5e-f34df9172b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:03.751719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1f83b956-0f5c-4ec1-9a5e-f34df9172b3e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:03.753016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1f83b956-0f5c-4ec1-9a5e-f34df9172b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:03.830400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:03.852608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 676/1336] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:04.140391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329f99-7de7-44de-8245-d50059d1f483 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:04.141962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-00329f99-7de7-44de-8245-d50059d1f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:04.242962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00329f99-7de7-44de-8245-d50059d1f483 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:04.271171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:04.316047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf429ec-34aa-461b-bf39-4ccdbfa79a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:04.316647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf429ec-34aa-461b-bf39-4ccdbfa79a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:04.316926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf429ec-34aa-461b-bf39-4ccdbfa79a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:04.317201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf429ec-34aa-461b-bf39-4ccdbfa79a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:04.318813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fcf429ec-34aa-461b-bf39-4ccdbfa79a26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:04.425675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf429ec-34aa-461b-bf39-4ccdbfa79a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:04.427226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf429ec-34aa-461b-bf39-4ccdbfa79a26 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:04.444992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 661/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:07.077406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc9497-762b-46f8-b20b-7bd86bafd7b3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:07.077964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc9497-762b-46f8-b20b-7bd86bafd7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:07.077964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc9497-762b-46f8-b20b-7bd86bafd7b3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:07.079273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 677/1338] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:07.084418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef357f-421b-41be-bf92-c793b4b75bb9 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:07.084836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef357f-421b-41be-bf92-c793b4b75bb9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:07.084976 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef357f-421b-41be-bf92-c793b4b75bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:07.150102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c6ef357f-421b-41be-bf92-c793b4b75bb9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:07.151327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c6ef357f-421b-41be-bf92-c793b4b75bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:07.160573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:07.266306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 662/1339] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:07.549819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc9497-762b-46f8-b20b-7bd86bafd7b3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:07.551444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-14cc9497-762b-46f8-b20b-7bd86bafd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:07.653706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc9497-762b-46f8-b20b-7bd86bafd7b3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:07.727556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3a97a-b6cc-4320-ba3c-84358b22b401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:07.728160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a97a-b6cc-4320-ba3c-84358b22b401 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:07.728436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a97a-b6cc-4320-ba3c-84358b22b401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:07.728706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a97a-b6cc-4320-ba3c-84358b22b401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:07.730319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8bc3a97a-b6cc-4320-ba3c-84358b22b401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:07.765664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:07.838223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3a97a-b6cc-4320-ba3c-84358b22b401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:07.839659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3a97a-b6cc-4320-ba3c-84358b22b401 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:07.858250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 678/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:12.029275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e9087-124a-4c8c-afad-a30bb4e9eb2e None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:12.029956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e9087-124a-4c8c-afad-a30bb4e9eb2e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:12.029956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e9087-124a-4c8c-afad-a30bb4e9eb2e None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:12.031152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 663/1341] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:12.036583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893a32d-d761-436e-98bc-af43bd51d831 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:12.037025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893a32d-d761-436e-98bc-af43bd51d831 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:12.037134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893a32d-d761-436e-98bc-af43bd51d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:12.106730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8893a32d-d761-436e-98bc-af43bd51d831 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:12.108462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8893a32d-d761-436e-98bc-af43bd51d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:12.196178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:12.208536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 679/1342] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:12.488982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e9087-124a-4c8c-afad-a30bb4e9eb2e None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:12.490570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e55e9087-124a-4c8c-afad-a30bb4e9eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:12.594879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e9087-124a-4c8c-afad-a30bb4e9eb2e None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:12.632612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:12.670509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f03b4-c2bb-4c6a-8f7c-19cefdc6884a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:12.671253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f03b4-c2bb-4c6a-8f7c-19cefdc6884a service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:12.671533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f03b4-c2bb-4c6a-8f7c-19cefdc6884a service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:12.671805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f03b4-c2bb-4c6a-8f7c-19cefdc6884a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:12.673450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7b6f03b4-c2bb-4c6a-8f7c-19cefdc6884a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:12.788131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f03b4-c2bb-4c6a-8f7c-19cefdc6884a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:12.789556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f03b4-c2bb-4c6a-8f7c-19cefdc6884a service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:12.807477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 664/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:15.584627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bc99-0e06-48b7-8cac-252247bb9eaa None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:15.585139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bc99-0e06-48b7-8cac-252247bb9eaa None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:15.585139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bc99-0e06-48b7-8cac-252247bb9eaa None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:15.586446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 680/1344] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:15.592285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5086a-5b71-4668-a932-436c21ba39b4 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:15.592712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5086a-5b71-4668-a932-436c21ba39b4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:15.592835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5086a-5b71-4668-a932-436c21ba39b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:15.659005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c4f5086a-5b71-4668-a932-436c21ba39b4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:15.660211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c4f5086a-5b71-4668-a932-436c21ba39b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:15.678404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:15.761611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 665/1345] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:16.052385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9bc99-0e06-48b7-8cac-252247bb9eaa None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:16.053957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6be9bc99-0e06-48b7-8cac-252247bb9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:16.173730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9bc99-0e06-48b7-8cac-252247bb9eaa None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:16.254572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d3561-91e8-425a-9dc7-494da281e806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:16.255174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d3561-91e8-425a-9dc7-494da281e806 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:16.255452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d3561-91e8-425a-9dc7-494da281e806 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:16.255721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d3561-91e8-425a-9dc7-494da281e806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:16.257308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-674d3561-91e8-425a-9dc7-494da281e806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:16.301705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:16.370775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d3561-91e8-425a-9dc7-494da281e806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:16.372775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d3561-91e8-425a-9dc7-494da281e806 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:16.392444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 681/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:20.525623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b87fd-f51e-46d3-bd57-c8732c63369c None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:20.526065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b87fd-f51e-46d3-bd57-c8732c63369c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:20.526285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b87fd-f51e-46d3-bd57-c8732c63369c None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:20.527614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 666/1347] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:20.533561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896cbc2-8cd9-4aca-b749-d760cfbe25dd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:20.534080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896cbc2-8cd9-4aca-b749-d760cfbe25dd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:20.534080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896cbc2-8cd9-4aca-b749-d760cfbe25dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:20.605006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6896cbc2-8cd9-4aca-b749-d760cfbe25dd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:20.606268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6896cbc2-8cd9-4aca-b749-d760cfbe25dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:20.710071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:20.712759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 682/1348] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:21.009320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b87fd-f51e-46d3-bd57-c8732c63369c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:21.010901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9e1b87fd-f51e-46d3-bd57-c8732c63369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:21.117304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b87fd-f51e-46d3-bd57-c8732c63369c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:21.164439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:21.191304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f52c35-5d75-4846-9784-109baf885791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:21.191899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52c35-5d75-4846-9784-109baf885791 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:21.192172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52c35-5d75-4846-9784-109baf885791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:21.192435 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52c35-5d75-4846-9784-109baf885791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:21.194060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-26f52c35-5d75-4846-9784-109baf885791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:21.299962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52c35-5d75-4846-9784-109baf885791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:21.301378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52c35-5d75-4846-9784-109baf885791 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:21.318779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 667/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:26.267576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94b42-a498-4164-a664-3bf61f27b5e2 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:26.268038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94b42-a498-4164-a664-3bf61f27b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:26.268133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b94b42-a498-4164-a664-3bf61f27b5e2 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:26.269603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 683/1350] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:26.275238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468d02-bd2b-4150-8603-e1f693f33564 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:26.276097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468d02-bd2b-4150-8603-e1f693f33564 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:26.276572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80468d02-bd2b-4150-8603-e1f693f33564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:26.412318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-80468d02-bd2b-4150-8603-e1f693f33564 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:26.413855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-80468d02-bd2b-4150-8603-e1f693f33564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:26.437214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:26.541415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 668/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:50:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:30.692252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2db62-886c-4031-8cba-466090ef3dce None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:30.692789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2db62-886c-4031-8cba-466090ef3dce None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:30.692789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2db62-886c-4031-8cba-466090ef3dce None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:30.694376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 684/1352] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:30.701297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574ae26-1896-4e02-a187-31d70c26f0a1 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:30.701780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574ae26-1896-4e02-a187-31d70c26f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:30.702388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574ae26-1896-4e02-a187-31d70c26f0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:30.782327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b574ae26-1896-4e02-a187-31d70c26f0a1 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:30.783530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b574ae26-1896-4e02-a187-31d70c26f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:30.858170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:30.896829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 669/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:32.443348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e88f39-62a4-4934-bd78-44bb38130723 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:32.443926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e88f39-62a4-4934-bd78-44bb38130723 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:32.443926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e88f39-62a4-4934-bd78-44bb38130723 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:32.445373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 685/1354] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:32.451150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2276fc-e50e-4289-9c2b-7abfc9a66b2f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:32.451594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2276fc-e50e-4289-9c2b-7abfc9a66b2f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:32.451830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2276fc-e50e-4289-9c2b-7abfc9a66b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:32.528001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-4c2276fc-e50e-4289-9c2b-7abfc9a66b2f None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:32.529236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4c2276fc-e50e-4289-9c2b-7abfc9a66b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:32.634209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 670/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:50:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:50:36.190123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb695c-06ea-4a02-9d90-4c4f4d7217b8 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:36.190987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb695c-06ea-4a02-9d90-4c4f4d7217b8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:36.191415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb695c-06ea-4a02-9d90-4c4f4d7217b8 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:36.193150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 686/1356] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:36.198587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714fe4-e69b-4d94-b8c3-77bac18f1655 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:36.200448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714fe4-e69b-4d94-b8c3-77bac18f1655 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:36.200824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714fe4-e69b-4d94-b8c3-77bac18f1655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:36.242481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:36.275100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-59714fe4-e69b-4d94-b8c3-77bac18f1655 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:36.276340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-59714fe4-e69b-4d94-b8c3-77bac18f1655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:36.379774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 671/1357] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:36.683994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee6a2-f69d-41a3-884a-056de168cbf6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:36.684732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee6a2-f69d-41a3-884a-056de168cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:36.685250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ee6a2-f69d-41a3-884a-056de168cbf6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:36.687028 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 687/1358] 10.222.0.52 () {54 vars in 962 bytes} [Fri Sep 9 14:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:36.694969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613b5bf-3c85-4334-8543-e85053c19e6e None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:36.700410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613b5bf-3c85-4334-8543-e85053c19e6e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:36.700637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613b5bf-3c85-4334-8543-e85053c19e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:36.784906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c613b5bf-3c85-4334-8543-e85053c19e6e None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:36.786116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c613b5bf-3c85-4334-8543-e85053c19e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:36.836259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:36.908836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 672/1359] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Sep 9 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:36.917497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ee6a2-f69d-41a3-884a-056de168cbf6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:36.919942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-773ee6a2-f69d-41a3-884a-056de168cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:37.100920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ee6a2-f69d-41a3-884a-056de168cbf6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:37.178330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:37.220979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb9680-cb87-40c6-8523-f0c6f3967c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:37.221685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9680-cb87-40c6-8523-f0c6f3967c44 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:37.221977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9680-cb87-40c6-8523-f0c6f3967c44 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:37.222333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb9680-cb87-40c6-8523-f0c6f3967c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:37.223974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b9eb9680-cb87-40c6-8523-f0c6f3967c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:37.324971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb9680-cb87-40c6-8523-f0c6f3967c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:37.328385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb9680-cb87-40c6-8523-f0c6f3967c44 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:37.357748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 688/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:39.739544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e114-7a01-4b32-9dee-4f043048c1af None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:39.740128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e114-7a01-4b32-9dee-4f043048c1af None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:39.740128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012e114-7a01-4b32-9dee-4f043048c1af None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:39.741428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 673/1361] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:39.746897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31c5b2-10ac-4ee1-b117-1654a9d003c5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:39.747345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31c5b2-10ac-4ee1-b117-1654a9d003c5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:39.747439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31c5b2-10ac-4ee1-b117-1654a9d003c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:39.816760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5e31c5b2-10ac-4ee1-b117-1654a9d003c5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:39.817959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5e31c5b2-10ac-4ee1-b117-1654a9d003c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:39.862433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:39.930929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 689/1362] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:40.217273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012e114-7a01-4b32-9dee-4f043048c1af None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:40.219187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0012e114-7a01-4b32-9dee-4f043048c1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:40.406918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012e114-7a01-4b32-9dee-4f043048c1af None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:40.420556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:40.550851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b94b8a-1381-4c31-b00b-84c8dbcad335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:40.551284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b94b8a-1381-4c31-b00b-84c8dbcad335 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:40.551284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b94b8a-1381-4c31-b00b-84c8dbcad335 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:40.551789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b94b8a-1381-4c31-b00b-84c8dbcad335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:40.553802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d3b94b8a-1381-4c31-b00b-84c8dbcad335 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:40.649709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b94b8a-1381-4c31-b00b-84c8dbcad335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:40.651384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b94b8a-1381-4c31-b00b-84c8dbcad335 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:40.669953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 674/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:43.192106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f51f-2a2c-4976-9c6c-b4702716564b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:43.192669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f51f-2a2c-4976-9c6c-b4702716564b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:43.192669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270f51f-2a2c-4976-9c6c-b4702716564b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:43.194159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 690/1364] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:43.199824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c821-7cd3-4fd8-a531-06ab4135cfec None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:43.200254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c821-7cd3-4fd8-a531-06ab4135cfec None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:43.200428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83c821-7cd3-4fd8-a531-06ab4135cfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:43.216952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:43.270636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fc83c821-7cd3-4fd8-a531-06ab4135cfec None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:43.271861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fc83c821-7cd3-4fd8-a531-06ab4135cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:43.378124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 675/1365] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:43.670405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf496e3-b236-4eb7-ba7e-9d70b4abf517 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:43.670699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf496e3-b236-4eb7-ba7e-9d70b4abf517 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:43.671129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf496e3-b236-4eb7-ba7e-9d70b4abf517 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:43.672691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 691/1366] 10.222.0.52 () {54 vars in 962 bytes} [Fri Sep 9 14:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:43.678212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2187d84-8115-418b-888e-332644c0061b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:43.678603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2187d84-8115-418b-888e-332644c0061b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:43.678978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2187d84-8115-418b-888e-332644c0061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:43.769154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b2187d84-8115-418b-888e-332644c0061b None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:43.770373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b2187d84-8115-418b-888e-332644c0061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:43.806905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:43.897502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 676/1367] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Sep 9 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:43.906058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf496e3-b236-4eb7-ba7e-9d70b4abf517 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:43.907987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-edf496e3-b236-4eb7-ba7e-9d70b4abf517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:44.068199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf496e3-b236-4eb7-ba7e-9d70b4abf517 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:44.090982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:44.193693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b577b-3673-493b-a1e5-82a7cdd45306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:44.194431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b577b-3673-493b-a1e5-82a7cdd45306 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:44.194521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b577b-3673-493b-a1e5-82a7cdd45306 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:44.194766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b577b-3673-493b-a1e5-82a7cdd45306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:44.196355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fd9b577b-3673-493b-a1e5-82a7cdd45306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:44.299950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b577b-3673-493b-a1e5-82a7cdd45306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:44.301575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b577b-3673-493b-a1e5-82a7cdd45306 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:44.321805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 692/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:50:44.395616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ec31-ec24-4c42-8580-5d5aac171543 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:44.396973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ec31-ec24-4c42-8580-5d5aac171543 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:44.397288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ec31-ec24-4c42-8580-5d5aac171543 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:44.398909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 677/1369] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:44.404792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e3e2-eb12-4d67-b449-bf95a7c8ee24 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:44.405080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e3e2-eb12-4d67-b449-bf95a7c8ee24 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:44.405356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e3e2-eb12-4d67-b449-bf95a7c8ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:44.449465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:44.494417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-14a0e3e2-eb12-4d67-b449-bf95a7c8ee24 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:44.496323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-14a0e3e2-eb12-4d67-b449-bf95a7c8ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:44.621986 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 693/1370] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:44.961178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7d107-4f54-4eab-b76a-856b557cd2db None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:44.961178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7d107-4f54-4eab-b76a-856b557cd2db None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:44.961178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7d107-4f54-4eab-b76a-856b557cd2db None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:44.963814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 678/1371] 10.222.0.52 () {54 vars in 964 bytes} [Fri Sep 9 14:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:44.967818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714555e-42a6-4ea0-8141-72990a07b950 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:44.968106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714555e-42a6-4ea0-8141-72990a07b950 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:44.968380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714555e-42a6-4ea0-8141-72990a07b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:45.051202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c714555e-42a6-4ea0-8141-72990a07b950 None None] MFA Rules not processed for user `23f4b0027d97468c9b6f73381eb76a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:45.052451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c714555e-42a6-4ea0-8141-72990a07b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:45.109842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:45.144416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 694/1372] 10.222.0.52 () {58 vars in 1061 bytes} [Fri Sep 9 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:45.152603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7d107-4f54-4eab-b76a-856b557cd2db None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:45.154602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f9c7d107-4f54-4eab-b76a-856b557cd2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:45.267459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7d107-4f54-4eab-b76a-856b557cd2db None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:45.316245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:45.375071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f67653-1905-4e34-bd59-502d6d38c2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:45.375643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67653-1905-4e34-bd59-502d6d38c2ae service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:45.376011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67653-1905-4e34-bd59-502d6d38c2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:45.376319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f67653-1905-4e34-bd59-502d6d38c2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:45.377870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-79f67653-1905-4e34-bd59-502d6d38c2ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:45.497790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f67653-1905-4e34-bd59-502d6d38c2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:45.499090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f67653-1905-4e34-bd59-502d6d38c2ae service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:45.522974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 679/1373] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:50:46.600915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa5a4-085a-47a8-a036-db07b5e3b056 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:46.601440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa5a4-085a-47a8-a036-db07b5e3b056 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:46.601563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa5a4-085a-47a8-a036-db07b5e3b056 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:46.602867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 695/1374] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:46.608332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e56-166f-447b-a7a9-ded209103897 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:46.608720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e56-166f-447b-a7a9-ded209103897 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:46.608889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f0e56-166f-447b-a7a9-ded209103897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:46.674744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-412f0e56-166f-447b-a7a9-ded209103897 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:46.675949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-412f0e56-166f-447b-a7a9-ded209103897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:46.696654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:46.778736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 680/1375] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:47.084306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa5a4-085a-47a8-a036-db07b5e3b056 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:47.086069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f79fa5a4-085a-47a8-a036-db07b5e3b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:47.256172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa5a4-085a-47a8-a036-db07b5e3b056 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:47.309707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:47.374262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d348d1-a316-4c8f-9351-95fc576d2dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:47.374795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d348d1-a316-4c8f-9351-95fc576d2dc9 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:47.375055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d348d1-a316-4c8f-9351-95fc576d2dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:47.375325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d348d1-a316-4c8f-9351-95fc576d2dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:47.376925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e9d348d1-a316-4c8f-9351-95fc576d2dc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:47.471159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d348d1-a316-4c8f-9351-95fc576d2dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:47.472762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d348d1-a316-4c8f-9351-95fc576d2dc9 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:47.491674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 696/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:49.743675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a6d2-b273-4bca-8e70-74ccc2114205 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:49.744229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a6d2-b273-4bca-8e70-74ccc2114205 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:49.744229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51a6d2-b273-4bca-8e70-74ccc2114205 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:49.746525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 681/1377] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:50:49.751871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2f76-4442-4752-a655-a099c81163f1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:49.752321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2f76-4442-4752-a655-a099c81163f1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:49.752622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2f76-4442-4752-a655-a099c81163f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:49.818957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2b4b2f76-4442-4752-a655-a099c81163f1 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:49.820169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2b4b2f76-4442-4752-a655-a099c81163f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:49.829107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:49.945057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 697/1378] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:50.239713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a6d2-b273-4bca-8e70-74ccc2114205 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:50.241382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3e51a6d2-b273-4bca-8e70-74ccc2114205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:50.401844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51a6d2-b273-4bca-8e70-74ccc2114205 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:50.406462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:50.530802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76220a-6224-4f63-82e6-9f62cf6b9912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:50.531444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76220a-6224-4f63-82e6-9f62cf6b9912 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:50.531729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76220a-6224-4f63-82e6-9f62cf6b9912 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:50.531997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76220a-6224-4f63-82e6-9f62cf6b9912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:50.533675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-dc76220a-6224-4f63-82e6-9f62cf6b9912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:50.642490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76220a-6224-4f63-82e6-9f62cf6b9912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:50.644125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76220a-6224-4f63-82e6-9f62cf6b9912 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:50.663886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 682/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:52.936222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5630-f24a-43e0-a005-39890b381dd5 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:52.936667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5630-f24a-43e0-a005-39890b381dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:52.937008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c5630-f24a-43e0-a005-39890b381dd5 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:52.938971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 698/1380] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:52.944737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3ce3e-d240-4f50-888a-7e40e7126c3d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:52.945116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3ce3e-d240-4f50-888a-7e40e7126c3d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:52.945510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3ce3e-d240-4f50-888a-7e40e7126c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:52.967050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:53.062650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e7d3ce3e-d240-4f50-888a-7e40e7126c3d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:53.065106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e7d3ce3e-d240-4f50-888a-7e40e7126c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:53.173270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 683/1381] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:53.481196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c5630-f24a-43e0-a005-39890b381dd5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:53.482789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d89c5630-f24a-43e0-a005-39890b381dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:53.628004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:53.638981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c5630-f24a-43e0-a005-39890b381dd5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:53.769263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb594538-b57b-4a7b-8b93-f8d0e1adb7d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:53.770001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594538-b57b-4a7b-8b93-f8d0e1adb7d0 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:53.770375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594538-b57b-4a7b-8b93-f8d0e1adb7d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:53.770719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb594538-b57b-4a7b-8b93-f8d0e1adb7d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:53.772806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fb594538-b57b-4a7b-8b93-f8d0e1adb7d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:53.879787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb594538-b57b-4a7b-8b93-f8d0e1adb7d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:53.881826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb594538-b57b-4a7b-8b93-f8d0e1adb7d0 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:53.896304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:53.907532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 699/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:50:56.107728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7bcf-c304-4d70-a7dd-7b9fce0c718f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:56.108249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7bcf-c304-4d70-a7dd-7b9fce0c718f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:56.108365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca7bcf-c304-4d70-a7dd-7b9fce0c718f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:56.110202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 684/1383] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:56.115573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f30d81-558f-44e7-b5cd-7d28c3146d48 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:56.116056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f30d81-558f-44e7-b5cd-7d28c3146d48 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:56.116153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f30d81-558f-44e7-b5cd-7d28c3146d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:56.182072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-72f30d81-558f-44e7-b5cd-7d28c3146d48 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:56.183528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-72f30d81-558f-44e7-b5cd-7d28c3146d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:56.291602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 700/1384] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:56.580069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7bcf-c304-4d70-a7dd-7b9fce0c718f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:56.581593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c4ca7bcf-c304-4d70-a7dd-7b9fce0c718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:56.672577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:56.741542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca7bcf-c304-4d70-a7dd-7b9fce0c718f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:56.859856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f3395-91d2-4c90-8f7e-1d4dd53766ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:56.860463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3395-91d2-4c90-8f7e-1d4dd53766ae service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:56.860738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3395-91d2-4c90-8f7e-1d4dd53766ae service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:56.861003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f3395-91d2-4c90-8f7e-1d4dd53766ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:56.862685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e35f3395-91d2-4c90-8f7e-1d4dd53766ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:56.913501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:56.964958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f3395-91d2-4c90-8f7e-1d4dd53766ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:50:56.967281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f3395-91d2-4c90-8f7e-1d4dd53766ae service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:50:56.991921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 685/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:50:59.231515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76e39-5ec6-481f-b76e-518720b0d94c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:59.232061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76e39-5ec6-481f-b76e-518720b0d94c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:59.232241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a76e39-5ec6-481f-b76e-518720b0d94c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:59.233737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 701/1386] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:50:59.239319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a35d-2843-414a-91d0-eaeb7835a5b7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:59.239739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a35d-2843-414a-91d0-eaeb7835a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:59.239863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a35d-2843-414a-91d0-eaeb7835a5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:59.307709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c597a35d-2843-414a-91d0-eaeb7835a5b7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:50:59.309029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c597a35d-2843-414a-91d0-eaeb7835a5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:59.407159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 686/1387] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:50:59.694636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a76e39-5ec6-481f-b76e-518720b0d94c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:50:59.696176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-43a76e39-5ec6-481f-b76e-518720b0d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:50:59.775275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:50:59.844924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a76e39-5ec6-481f-b76e-518720b0d94c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:50:59.959565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6768f9-d208-4151-bb2a-3efed1c73ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:50:59.960083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6768f9-d208-4151-bb2a-3efed1c73ee6 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:50:59.960357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6768f9-d208-4151-bb2a-3efed1c73ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:50:59.960623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6768f9-d208-4151-bb2a-3efed1c73ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:50:59.962227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bc6768f9-d208-4151-bb2a-3efed1c73ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:00.001353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:00.053160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6768f9-d208-4151-bb2a-3efed1c73ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:00.054847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6768f9-d208-4151-bb2a-3efed1c73ee6 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:00.073254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 702/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:00.852748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504498f-c562-4222-bb47-b2ff75a3f9d2 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:00.853261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504498f-c562-4222-bb47-b2ff75a3f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:00.853261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504498f-c562-4222-bb47-b2ff75a3f9d2 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:00.854774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 687/1389] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:00.860103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9212-d08d-47b8-98e6-7df8c12d1442 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:00.860552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9212-d08d-47b8-98e6-7df8c12d1442 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:00.860651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c9212-d08d-47b8-98e6-7df8c12d1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:00.928493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d83c9212-d08d-47b8-98e6-7df8c12d1442 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:00.929705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d83c9212-d08d-47b8-98e6-7df8c12d1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:01.030307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 703/1390] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:01.335703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ba1d-8843-4911-b58f-418b17bd1316 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:01.336062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ba1d-8843-4911-b58f-418b17bd1316 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:01.336342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9ba1d-8843-4911-b58f-418b17bd1316 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:01.337710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 688/1391] 10.222.0.52 () {54 vars in 966 bytes} [Fri Sep 9 14:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:01.343201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9323-f9f0-4510-932e-d2be977b8f21 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:01.343491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9323-f9f0-4510-932e-d2be977b8f21 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:01.343771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9323-f9f0-4510-932e-d2be977b8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:01.359710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:01.425259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5e7f9323-f9f0-4510-932e-d2be977b8f21 None None] MFA Rules not processed for user `3849cb5e321d48c88f0e19121ec7e1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:01.426494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5e7f9323-f9f0-4510-932e-d2be977b8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:01.504050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 704/1392] 10.222.0.52 () {58 vars in 1063 bytes} [Fri Sep 9 14:51:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:01.527930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9ba1d-8843-4911-b58f-418b17bd1316 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:01.527930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-46f9ba1d-8843-4911-b58f-418b17bd1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:01.556235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:01.631802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9ba1d-8843-4911-b58f-418b17bd1316 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:01.713410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f181dee-abc9-4113-9cd0-05efce5adbed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3849cb5e321d48c88f0e19121ec7e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:01.714209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f181dee-abc9-4113-9cd0-05efce5adbed service glance] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:01.714490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f181dee-abc9-4113-9cd0-05efce5adbed service glance] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:01.714762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f181dee-abc9-4113-9cd0-05efce5adbed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:01.716355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5f181dee-abc9-4113-9cd0-05efce5adbed service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:01.795186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:01.828578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f181dee-abc9-4113-9cd0-05efce5adbed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:01.829931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f181dee-abc9-4113-9cd0-05efce5adbed service glance] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:01.848207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 689/1393] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:02.284493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd48b5-8b67-498c-9ea7-557325427763 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:02.285048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd48b5-8b67-498c-9ea7-557325427763 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:02.285153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd48b5-8b67-498c-9ea7-557325427763 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:02.286466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 705/1394] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:02.292246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:02.292709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:02.292813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:02.358855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:02.360034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:02.468666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 690/1395] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:02.600026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9549-9c8a-4457-b72c-a013ae7e633f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:02.600419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9549-9c8a-4457-b72c-a013ae7e633f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:02.600761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c9549-9c8a-4457-b72c-a013ae7e633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:02.668814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fc1c9549-9c8a-4457-b72c-a013ae7e633f None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:02.670015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fc1c9549-9c8a-4457-b72c-a013ae7e633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:02.726197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:02.758450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 706/1396] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:02.767229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:02.768585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:02.807811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d52e-d120-493a-bf89-e89a0ccb8979 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:02.808098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d52e-d120-493a-bf89-e89a0ccb8979 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:02.808368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7d52e-d120-493a-bf89-e89a0ccb8979 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:02.809728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 707/1397] 10.222.0.52 () {54 vars in 943 bytes} [Fri Sep 9 14:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:51:02.811477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:02.816416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de10d-a33b-4bab-b0d4-5a2663873e71 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:02.816701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de10d-a33b-4bab-b0d4-5a2663873e71 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:02.816977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de10d-a33b-4bab-b0d4-5a2663873e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:02.888546 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683d24-0379-4c45-9d81-78e6d8390efc None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:02.894422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-058de10d-a33b-4bab-b0d4-5a2663873e71 None None] MFA Rules not processed for user `c7d4404bc9fb4bae8e8114daecd6409a`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:02.895630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-058de10d-a33b-4bab-b0d4-5a2663873e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:03.004752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645e27e-fe57-4787-990a-eb47b6e7e2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:03.005358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645e27e-fe57-4787-990a-eb47b6e7e2b9 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:03.005633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645e27e-fe57-4787-990a-eb47b6e7e2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:03.005898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645e27e-fe57-4787-990a-eb47b6e7e2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:03.007518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f645e27e-fe57-4787-990a-eb47b6e7e2b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:03.011132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 708/1398] 10.222.0.52 () {58 vars in 1040 bytes} [Fri Sep 9 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:51:03.020160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de10d-a33b-4bab-b0d4-5a2663873e71 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:03.030564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de10d-a33b-4bab-b0d4-5a2663873e71 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:03.044583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:03.057268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:03.103033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645e27e-fe57-4787-990a-eb47b6e7e2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:03.104698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645e27e-fe57-4787-990a-eb47b6e7e2b9 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:03.123328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 691/1399] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:03.140501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bc25-af97-4191-847e-bd85dc6f96f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:03.141216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bc25-af97-4191-847e-bd85dc6f96f7 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:03.141514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bc25-af97-4191-847e-bd85dc6f96f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:03.141834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bc25-af97-4191-847e-bd85dc6f96f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:03.143538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-70d4bc25-af97-4191-847e-bd85dc6f96f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:03.256731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bc25-af97-4191-847e-bd85dc6f96f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:03.258462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bc25-af97-4191-847e-bd85dc6f96f7 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:03.268553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 709/1400] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 14:51:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 14:51:05.358313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f092abe-0d99-4bb8-ad06-ffd9b15279fc None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:05.358927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f092abe-0d99-4bb8-ad06-ffd9b15279fc None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:05.358927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f092abe-0d99-4bb8-ad06-ffd9b15279fc None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:05.360205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 692/1401] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:05.365689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364fa6e-3787-4ec9-b135-5a4cc470c135 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:05.366178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364fa6e-3787-4ec9-b135-5a4cc470c135 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:05.366391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364fa6e-3787-4ec9-b135-5a4cc470c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:05.438185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5364fa6e-3787-4ec9-b135-5a4cc470c135 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:05.439515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5364fa6e-3787-4ec9-b135-5a4cc470c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:05.446649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:05.554168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 710/1402] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:05.846037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f092abe-0d99-4bb8-ad06-ffd9b15279fc None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:05.846037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0f092abe-0d99-4bb8-ad06-ffd9b15279fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:06.011474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f092abe-0d99-4bb8-ad06-ffd9b15279fc None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:06.024402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:06.158991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c4073-ec9b-4eae-9d8e-9228aca5bfb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:06.159602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4073-ec9b-4eae-9d8e-9228aca5bfb9 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:06.159872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4073-ec9b-4eae-9d8e-9228aca5bfb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:06.160138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c4073-ec9b-4eae-9d8e-9228aca5bfb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:06.161756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-941c4073-ec9b-4eae-9d8e-9228aca5bfb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:06.265243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c4073-ec9b-4eae-9d8e-9228aca5bfb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:06.268097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c4073-ec9b-4eae-9d8e-9228aca5bfb9 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:06.288400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 693/1403] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:08.730900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37d8e-ddea-4be4-8bff-7ae61dc53c41 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:08.731421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37d8e-ddea-4be4-8bff-7ae61dc53c41 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:08.731421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d37d8e-ddea-4be4-8bff-7ae61dc53c41 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:08.732678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 711/1404] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:08.737888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9549b7-8290-42da-8036-4c431fa27598 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:08.738330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9549b7-8290-42da-8036-4c431fa27598 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:08.738511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9549b7-8290-42da-8036-4c431fa27598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:08.760674 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:08.815693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1b9549b7-8290-42da-8036-4c431fa27598 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:08.816934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1b9549b7-8290-42da-8036-4c431fa27598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:08.939502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 694/1405] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:09.240303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d37d8e-ddea-4be4-8bff-7ae61dc53c41 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:09.241848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f3d37d8e-ddea-4be4-8bff-7ae61dc53c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:09.482404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:09.496594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d37d8e-ddea-4be4-8bff-7ae61dc53c41 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:09.619476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4be1a0-79dc-4bad-8d9f-b1f45ae8f767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:09.620122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be1a0-79dc-4bad-8d9f-b1f45ae8f767 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:09.620400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be1a0-79dc-4bad-8d9f-b1f45ae8f767 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:09.620668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be1a0-79dc-4bad-8d9f-b1f45ae8f767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:09.622299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7b4be1a0-79dc-4bad-8d9f-b1f45ae8f767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:09.734370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be1a0-79dc-4bad-8d9f-b1f45ae8f767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:09.737713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be1a0-79dc-4bad-8d9f-b1f45ae8f767 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:09.749681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:09.759387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 712/1406] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:11.965906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dce2ae-8972-464b-a24a-320b8d82119a None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:11.966474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dce2ae-8972-464b-a24a-320b8d82119a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:11.966474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dce2ae-8972-464b-a24a-320b8d82119a None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:11.967764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 695/1407] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:11.973072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a48c9a-920f-4dd7-b0b5-de556682c018 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:11.973495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a48c9a-920f-4dd7-b0b5-de556682c018 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:11.973625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a48c9a-920f-4dd7-b0b5-de556682c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:12.051806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-83a48c9a-920f-4dd7-b0b5-de556682c018 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:12.053185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-83a48c9a-920f-4dd7-b0b5-de556682c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:12.168538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 713/1408] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:51:12.460240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dce2ae-8972-464b-a24a-320b8d82119a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:12.461805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-25dce2ae-8972-464b-a24a-320b8d82119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:12.567991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:12.629116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dce2ae-8972-464b-a24a-320b8d82119a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:12.758686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dc8d2-441f-4c00-abe0-83c55fbcb549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:12.759916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dc8d2-441f-4c00-abe0-83c55fbcb549 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:12.760260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dc8d2-441f-4c00-abe0-83c55fbcb549 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:12.760535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dc8d2-441f-4c00-abe0-83c55fbcb549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:12.762170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3f6dc8d2-441f-4c00-abe0-83c55fbcb549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:12.829510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:12.863555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dc8d2-441f-4c00-abe0-83c55fbcb549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:12.865178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dc8d2-441f-4c00-abe0-83c55fbcb549 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:12.884720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 696/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:22.167138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=67 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:22.882145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=20 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:26.228833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1824-e8bf-45f7-8326-36693d925250 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:26.229623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1824-e8bf-45f7-8326-36693d925250 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:26.229623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1824-e8bf-45f7-8326-36693d925250 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:26.230734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 714/1410] 10.222.0.52 () {54 vars in 918 bytes} [Fri Sep 9 14:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:26.235655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5773-a769-4266-8f86-ac23332db521 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:26.236082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5773-a769-4266-8f86-ac23332db521 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:26.236196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab5773-a769-4266-8f86-ac23332db521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:26.312170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-65ab5773-a769-4266-8f86-ac23332db521 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:26.313376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-65ab5773-a769-4266-8f86-ac23332db521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:26.419013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 697/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Sep 9 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:26.433019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5971f1-c42b-4cd9-b490-295d11ff37ee None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:26.433329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5971f1-c42b-4cd9-b490-295d11ff37ee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:26.433605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5971f1-c42b-4cd9-b490-295d11ff37ee None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:26.434960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 715/1412] 10.222.0.52 () {54 vars in 918 bytes} [Fri Sep 9 14:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:51:26.440113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b40d-b81c-4541-ac47-d0e9b49d2e66 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:26.440401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b40d-b81c-4541-ac47-d0e9b49d2e66 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:26.440703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629b40d-b81c-4541-ac47-d0e9b49d2e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:26.515227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:26.517901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a629b40d-b81c-4541-ac47-d0e9b49d2e66 None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:26.519713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a629b40d-b81c-4541-ac47-d0e9b49d2e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:26.636777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 698/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Sep 9 14:51:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:51:29.201987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477d3f-5fa8-4146-b363-4ba9e569876f None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:29.202547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477d3f-5fa8-4146-b363-4ba9e569876f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:29.202547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477d3f-5fa8-4146-b363-4ba9e569876f None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:29.203936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:29.209267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb6f7-6ba6-4a82-8af5-5bacf14c9b1a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:29.209681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb6f7-6ba6-4a82-8af5-5bacf14c9b1a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:29.209851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb6f7-6ba6-4a82-8af5-5bacf14c9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:29.277476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f7cdb6f7-6ba6-4a82-8af5-5bacf14c9b1a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:29.278720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f7cdb6f7-6ba6-4a82-8af5-5bacf14c9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:29.334784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:29.383211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:29.724934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477d3f-5fa8-4146-b363-4ba9e569876f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:29.726590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c5477d3f-5fa8-4146-b363-4ba9e569876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:29.897626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477d3f-5fa8-4146-b363-4ba9e569876f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:29.975495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:30.021773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c87fb3-1089-4803-a464-f6adea6e01e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:30.022414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c87fb3-1089-4803-a464-f6adea6e01e5 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:30.022694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c87fb3-1089-4803-a464-f6adea6e01e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:30.022966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c87fb3-1089-4803-a464-f6adea6e01e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:30.024579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f2c87fb3-1089-4803-a464-f6adea6e01e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:30.125720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c87fb3-1089-4803-a464-f6adea6e01e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:30.127470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c87fb3-1089-4803-a464-f6adea6e01e5 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:30.149023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 717/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:31.294902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06832b92-263e-48a2-b3ff-1739978990e8 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:31.295475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06832b92-263e-48a2-b3ff-1739978990e8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:31.295475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06832b92-263e-48a2-b3ff-1739978990e8 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:31.296785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:31.303182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28054bb-e335-401b-9e72-17130b23f9b7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:31.303613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28054bb-e335-401b-9e72-17130b23f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:31.303729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28054bb-e335-401b-9e72-17130b23f9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:31.379317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d28054bb-e335-401b-9e72-17130b23f9b7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:31.380522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d28054bb-e335-401b-9e72-17130b23f9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:31.408116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:31.477726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:51:31.626180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06832b92-263e-48a2-b3ff-1739978990e8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:31.627641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-06832b92-263e-48a2-b3ff-1739978990e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:31.770981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06832b92-263e-48a2-b3ff-1739978990e8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:31.811099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:31.883715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6577c-faf4-49c0-9762-54bd1c303188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:31.884239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6577c-faf4-49c0-9762-54bd1c303188 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:31.884517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6577c-faf4-49c0-9762-54bd1c303188 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:31.884786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6577c-faf4-49c0-9762-54bd1c303188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:31.886985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-70d6577c-faf4-49c0-9762-54bd1c303188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:31.975102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6577c-faf4-49c0-9762-54bd1c303188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:31.976726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6577c-faf4-49c0-9762-54bd1c303188 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:31.994406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 701/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:33.129672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f627-714e-44e1-96d3-c94117781673 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:33.130270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f627-714e-44e1-96d3-c94117781673 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:33.130270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f627-714e-44e1-96d3-c94117781673 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:33.131611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:33.138695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ba687-8c81-46d1-abf4-af44c7f10977 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:33.139150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ba687-8c81-46d1-abf4-af44c7f10977 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:33.139261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ba687-8c81-46d1-abf4-af44c7f10977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:33.194256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:33.334063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fa8ba687-8c81-46d1-abf4-af44c7f10977 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:33.335337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fa8ba687-8c81-46d1-abf4-af44c7f10977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:33.430714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:33.584898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120f627-714e-44e1-96d3-c94117781673 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:33.586539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0120f627-714e-44e1-96d3-c94117781673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:33.733867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120f627-714e-44e1-96d3-c94117781673 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:33.746404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:33.848920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a5135-cb83-4a93-9f19-2a667015178c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:33.849520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a5135-cb83-4a93-9f19-2a667015178c service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:33.849796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a5135-cb83-4a93-9f19-2a667015178c service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:33.850062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a5135-cb83-4a93-9f19-2a667015178c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:33.851680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6a6a5135-cb83-4a93-9f19-2a667015178c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:33.942127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a5135-cb83-4a93-9f19-2a667015178c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:33.943732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a5135-cb83-4a93-9f19-2a667015178c service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:33.961671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 720/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:35.070051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151f99-9f83-4195-a064-24454928b7d0 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:35.070615 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151f99-9f83-4195-a064-24454928b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:35.070615 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a151f99-9f83-4195-a064-24454928b7d0 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:35.072128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:35.079547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424bdf8-5d50-4d46-b2d8-4b7b4628b279 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:35.080020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424bdf8-5d50-4d46-b2d8-4b7b4628b279 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:35.080132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424bdf8-5d50-4d46-b2d8-4b7b4628b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:35.099773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:35.156140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3424bdf8-5d50-4d46-b2d8-4b7b4628b279 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:35.157304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3424bdf8-5d50-4d46-b2d8-4b7b4628b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:35.257169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:35.407823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a151f99-9f83-4195-a064-24454928b7d0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:35.409319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2a151f99-9f83-4195-a064-24454928b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:35.524354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:35.561748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a151f99-9f83-4195-a064-24454928b7d0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:35.678583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e580b4-2368-472f-8af6-c6210f0ed521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:35.679147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e580b4-2368-472f-8af6-c6210f0ed521 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:35.679418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e580b4-2368-472f-8af6-c6210f0ed521 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:35.679681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e580b4-2368-472f-8af6-c6210f0ed521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:35.681246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d9e580b4-2368-472f-8af6-c6210f0ed521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:35.759653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:35.773258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e580b4-2368-472f-8af6-c6210f0ed521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:35.774873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e580b4-2368-472f-8af6-c6210f0ed521 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:35.794927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 704/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:36.896784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea845a53-9909-4144-906c-c9eca935298a None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:36.897351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea845a53-9909-4144-906c-c9eca935298a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:36.897351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea845a53-9909-4144-906c-c9eca935298a None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:36.898679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:36.905526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743617e-e230-4e98-b5c2-aa75f74d31e6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:36.905944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743617e-e230-4e98-b5c2-aa75f74d31e6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:36.906067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743617e-e230-4e98-b5c2-aa75f74d31e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:36.981297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f743617e-e230-4e98-b5c2-aa75f74d31e6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:36.982542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f743617e-e230-4e98-b5c2-aa75f74d31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:37.077133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:37.225638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea845a53-9909-4144-906c-c9eca935298a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:37.227135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ea845a53-9909-4144-906c-c9eca935298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:37.312061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:37.374619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea845a53-9909-4144-906c-c9eca935298a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:37.490769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa0a7c-aa56-4682-b8e6-734c4fb05229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:37.491302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0a7c-aa56-4682-b8e6-734c4fb05229 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:37.491582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0a7c-aa56-4682-b8e6-734c4fb05229 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:37.491851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa0a7c-aa56-4682-b8e6-734c4fb05229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:37.493454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e3fa0a7c-aa56-4682-b8e6-734c4fb05229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:37.542470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:37.584551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa0a7c-aa56-4682-b8e6-734c4fb05229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:37.586158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa0a7c-aa56-4682-b8e6-734c4fb05229 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:37.603740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 723/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:38.656451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9b147-da3c-48fe-acbb-1e59e95bdb6b None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:38.656981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9b147-da3c-48fe-acbb-1e59e95bdb6b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:38.656981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9b147-da3c-48fe-acbb-1e59e95bdb6b None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:38.658357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:38.664782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ec90-dea7-41f9-9fa2-9df6b701c5eb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:38.665201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ec90-dea7-41f9-9fa2-9df6b701c5eb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:38.665389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ec90-dea7-41f9-9fa2-9df6b701c5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:38.744280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-88f3ec90-dea7-41f9-9fa2-9df6b701c5eb None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:38.745406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-88f3ec90-dea7-41f9-9fa2-9df6b701c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:38.841427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:38.992564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9b147-da3c-48fe-acbb-1e59e95bdb6b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:38.994052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-eef9b147-da3c-48fe-acbb-1e59e95bdb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:39.042242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:39.138541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9b147-da3c-48fe-acbb-1e59e95bdb6b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:39.248521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eb0c6-805b-413d-960c-2e51f778b1b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:39.249114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb0c6-805b-413d-960c-2e51f778b1b1 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:39.249389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb0c6-805b-413d-960c-2e51f778b1b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:39.249656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb0c6-805b-413d-960c-2e51f778b1b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:39.251286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bb7eb0c6-805b-413d-960c-2e51f778b1b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:39.258046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:39.343313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eb0c6-805b-413d-960c-2e51f778b1b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:39.344852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eb0c6-805b-413d-960c-2e51f778b1b1 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:39.362354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 707/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:40.409214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b47e-23bc-4533-9d70-772f42f5e575 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:40.409794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b47e-23bc-4533-9d70-772f42f5e575 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:40.409794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b47e-23bc-4533-9d70-772f42f5e575 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:40.411115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:40.417405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1875-b246-40e2-b931-6d507df19e59 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:40.417803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1875-b246-40e2-b931-6d507df19e59 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:40.418486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1875-b246-40e2-b931-6d507df19e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:40.493179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a26d1875-b246-40e2-b931-6d507df19e59 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:40.494418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a26d1875-b246-40e2-b931-6d507df19e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:40.561282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:40.590009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:40.739833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937b47e-23bc-4533-9d70-772f42f5e575 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:40.741313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7937b47e-23bc-4533-9d70-772f42f5e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:40.758978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:40.885754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937b47e-23bc-4533-9d70-772f42f5e575 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:40.971905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:40.997756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e78cbd-2958-4c62-a53a-dd3d07c59182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:40.998754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78cbd-2958-4c62-a53a-dd3d07c59182 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:40.999059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78cbd-2958-4c62-a53a-dd3d07c59182 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:40.999331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e78cbd-2958-4c62-a53a-dd3d07c59182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:41.000907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-43e78cbd-2958-4c62-a53a-dd3d07c59182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:41.090865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78cbd-2958-4c62-a53a-dd3d07c59182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:41.092446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e78cbd-2958-4c62-a53a-dd3d07c59182 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:41.110597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 726/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:42.173365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34a501-7e2d-4a1b-b420-5b0a38e24849 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:42.173940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34a501-7e2d-4a1b-b420-5b0a38e24849 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:42.173940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34a501-7e2d-4a1b-b420-5b0a38e24849 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:42.175294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:42.181541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9466e18-7e2e-4346-b8d4-1f59d8b4a7cf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:42.181987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9466e18-7e2e-4346-b8d4-1f59d8b4a7cf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:42.182142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9466e18-7e2e-4346-b8d4-1f59d8b4a7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:42.258007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b9466e18-7e2e-4346-b8d4-1f59d8b4a7cf None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:42.259229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b9466e18-7e2e-4346-b8d4-1f59d8b4a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:42.300831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:42.355426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:42.504560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34a501-7e2d-4a1b-b420-5b0a38e24849 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:42.506132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ab34a501-7e2d-4a1b-b420-5b0a38e24849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:42.651814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34a501-7e2d-4a1b-b420-5b0a38e24849 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:42.706936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:42.766035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ba50-5dd6-40c6-a172-0bb928022bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:42.766666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ba50-5dd6-40c6-a172-0bb928022bd5 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:42.766943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ba50-5dd6-40c6-a172-0bb928022bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:42.767210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ba50-5dd6-40c6-a172-0bb928022bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:42.768798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4b75ba50-5dd6-40c6-a172-0bb928022bd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:42.858066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75ba50-5dd6-40c6-a172-0bb928022bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:42.859660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75ba50-5dd6-40c6-a172-0bb928022bd5 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:42.877400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 710/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:43.937691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43630b55-b36e-4ece-9ef1-c8567b8e2626 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:43.938305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43630b55-b36e-4ece-9ef1-c8567b8e2626 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:43.938305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43630b55-b36e-4ece-9ef1-c8567b8e2626 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:43.939628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:43.945834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9844-4544-4bb2-9c01-0a19042b6092 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:43.946288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9844-4544-4bb2-9c01-0a19042b6092 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:43.946399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9844-4544-4bb2-9c01-0a19042b6092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:44.022117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-28ab9844-4544-4bb2-9c01-0a19042b6092 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:44.023233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-28ab9844-4544-4bb2-9c01-0a19042b6092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:44.025186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:44.121122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:44.272962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43630b55-b36e-4ece-9ef1-c8567b8e2626 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:44.274452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-43630b55-b36e-4ece-9ef1-c8567b8e2626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:44.419464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43630b55-b36e-4ece-9ef1-c8567b8e2626 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:44.446033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:44.533559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762149-1c3a-4ca9-bd1f-5854dbf7cf45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:44.534074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762149-1c3a-4ca9-bd1f-5854dbf7cf45 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:44.534443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762149-1c3a-4ca9-bd1f-5854dbf7cf45 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:44.534719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762149-1c3a-4ca9-bd1f-5854dbf7cf45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:44.536279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-25762149-1c3a-4ca9-bd1f-5854dbf7cf45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:44.624597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762149-1c3a-4ca9-bd1f-5854dbf7cf45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:44.626209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762149-1c3a-4ca9-bd1f-5854dbf7cf45 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:44.643802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 729/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:46.725647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792527e4-cbed-4935-9ea4-dad488698848 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:46.726079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792527e4-cbed-4935-9ea4-dad488698848 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:46.726215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792527e4-cbed-4935-9ea4-dad488698848 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:46.727565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:46.733279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f5bf-eba8-4cff-9da3-1d7c5cdf5dfb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:46.733681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f5bf-eba8-4cff-9da3-1d7c5cdf5dfb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:46.733834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f5bf-eba8-4cff-9da3-1d7c5cdf5dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:46.774264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:46.800578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c131f5bf-eba8-4cff-9da3-1d7c5cdf5dfb None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:46.801791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c131f5bf-eba8-4cff-9da3-1d7c5cdf5dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:46.897848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:47.180917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792527e4-cbed-4935-9ea4-dad488698848 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:47.182484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-792527e4-cbed-4935-9ea4-dad488698848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:47.286073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792527e4-cbed-4935-9ea4-dad488698848 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:47.317523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:47.360368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4088d-e895-4da5-ba0b-ce696d1ab142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:47.360968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4088d-e895-4da5-ba0b-ce696d1ab142 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:47.361245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4088d-e895-4da5-ba0b-ce696d1ab142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:47.361553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4088d-e895-4da5-ba0b-ce696d1ab142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:47.363193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9fc4088d-e895-4da5-ba0b-ce696d1ab142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:47.473042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4088d-e895-4da5-ba0b-ce696d1ab142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:47.474445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4088d-e895-4da5-ba0b-ce696d1ab142 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:47.491990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 713/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:49.777574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f5278-8d0b-40ac-b49f-d80f38901bfa None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:49.778161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f5278-8d0b-40ac-b49f-d80f38901bfa None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:49.778273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f5278-8d0b-40ac-b49f-d80f38901bfa None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:49.779550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:49.784625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f69db-f357-4dc3-aa57-f92e57d745d8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:49.785070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f69db-f357-4dc3-aa57-f92e57d745d8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:49.785191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f69db-f357-4dc3-aa57-f92e57d745d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:49.851320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-265f69db-f357-4dc3-aa57-f92e57d745d8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:49.852512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-265f69db-f357-4dc3-aa57-f92e57d745d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:49.865339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:49.949266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:50.238914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f5278-8d0b-40ac-b49f-d80f38901bfa None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:50.240476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d64f5278-8d0b-40ac-b49f-d80f38901bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:50.342376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f5278-8d0b-40ac-b49f-d80f38901bfa None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:50.354107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:50.414542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f059657-3872-49fd-bcd1-cea851caad56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:50.415143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059657-3872-49fd-bcd1-cea851caad56 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:50.415421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059657-3872-49fd-bcd1-cea851caad56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:50.415693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f059657-3872-49fd-bcd1-cea851caad56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:50.417284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1f059657-3872-49fd-bcd1-cea851caad56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:50.526999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f059657-3872-49fd-bcd1-cea851caad56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:50.529284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f059657-3872-49fd-bcd1-cea851caad56 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:50.547633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 732/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:53.014770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4aca5-3f63-4b9d-b49e-2350f1f74e08 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:53.015304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4aca5-3f63-4b9d-b49e-2350f1f74e08 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:53.015304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4aca5-3f63-4b9d-b49e-2350f1f74e08 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:53.016656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:53.021931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c9846-bfb2-483e-921b-309758665ef7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:53.022387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c9846-bfb2-483e-921b-309758665ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:53.022536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c9846-bfb2-483e-921b-309758665ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:53.070971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:53.089193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d01c9846-bfb2-483e-921b-309758665ef7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:53.091030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d01c9846-bfb2-483e-921b-309758665ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:53.186461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:53.476074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4aca5-3f63-4b9d-b49e-2350f1f74e08 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:53.477646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4fd4aca5-3f63-4b9d-b49e-2350f1f74e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:53.586715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4aca5-3f63-4b9d-b49e-2350f1f74e08 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:53.627137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:53.661061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0aacc-5af9-45d3-b6b4-e72f61ab9756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:53.661653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0aacc-5af9-45d3-b6b4-e72f61ab9756 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:53.661926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0aacc-5af9-45d3-b6b4-e72f61ab9756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:53.662230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0aacc-5af9-45d3-b6b4-e72f61ab9756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:53.663808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-03a0aacc-5af9-45d3-b6b4-e72f61ab9756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:53.771647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0aacc-5af9-45d3-b6b4-e72f61ab9756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:53.772998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0aacc-5af9-45d3-b6b4-e72f61ab9756 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:53.791088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 716/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:56.039202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d242-2363-484a-8576-68015f21096d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:56.039714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d242-2363-484a-8576-68015f21096d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:56.039714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d242-2363-484a-8576-68015f21096d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:56.040981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:56.047063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7978d7-910c-4d72-ae9a-bff21b05dcd8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:56.047454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7978d7-910c-4d72-ae9a-bff21b05dcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:56.047614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7978d7-910c-4d72-ae9a-bff21b05dcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:56.113609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-bb7978d7-910c-4d72-ae9a-bff21b05dcd8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:56.114829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bb7978d7-910c-4d72-ae9a-bff21b05dcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:56.134579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:56.210430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:56.493146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77d242-2363-484a-8576-68015f21096d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:56.494403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ca77d242-2363-484a-8576-68015f21096d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:56.599586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77d242-2363-484a-8576-68015f21096d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:56.620107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:56.673999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02fa99-1398-458e-8564-85c06f175844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:56.674630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02fa99-1398-458e-8564-85c06f175844 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:56.674904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02fa99-1398-458e-8564-85c06f175844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:56.675168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02fa99-1398-458e-8564-85c06f175844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:56.676753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4e02fa99-1398-458e-8564-85c06f175844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:56.786562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02fa99-1398-458e-8564-85c06f175844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:56.787922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02fa99-1398-458e-8564-85c06f175844 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:56.805644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 735/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:51:59.005111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf957e-6f2e-4a5a-9edb-fdce52699e98 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:59.005652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf957e-6f2e-4a5a-9edb-fdce52699e98 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:59.005786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf957e-6f2e-4a5a-9edb-fdce52699e98 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:59.007091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:51:59.012359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132332-ab36-4681-a35b-9a755bbe76e5 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:59.012937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132332-ab36-4681-a35b-9a755bbe76e5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:59.012937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d132332-ab36-4681-a35b-9a755bbe76e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:59.077257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:59.080541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6d132332-ab36-4681-a35b-9a755bbe76e5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:51:59.082131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6d132332-ab36-4681-a35b-9a755bbe76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:59.178522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:51:59.461227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf957e-6f2e-4a5a-9edb-fdce52699e98 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:51:59.462807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c2bf957e-6f2e-4a5a-9edb-fdce52699e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:59.566928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf957e-6f2e-4a5a-9edb-fdce52699e98 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:51:59.617430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:51:59.643127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc42f0-5938-4e5c-a1a2-0a8ef3af0d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:51:59.643729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc42f0-5938-4e5c-a1a2-0a8ef3af0d37 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:51:59.644005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc42f0-5938-4e5c-a1a2-0a8ef3af0d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:51:59.644274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc42f0-5938-4e5c-a1a2-0a8ef3af0d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:51:59.645866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4bfc42f0-5938-4e5c-a1a2-0a8ef3af0d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:51:59.754133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc42f0-5938-4e5c-a1a2-0a8ef3af0d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:51:59.755505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc42f0-5938-4e5c-a1a2-0a8ef3af0d37 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:51:59.773423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 719/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:01.969728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18410217-20c1-407b-b845-3ec8320d2f9d None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:01.970292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18410217-20c1-407b-b845-3ec8320d2f9d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:01.970292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18410217-20c1-407b-b845-3ec8320d2f9d None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:01.971559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:01.976994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf967-59c7-4a1c-8f99-08e28dbb6349 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:01.977436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf967-59c7-4a1c-8f99-08e28dbb6349 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:01.977543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bf967-59c7-4a1c-8f99-08e28dbb6349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:02.043208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c47bf967-59c7-4a1c-8f99-08e28dbb6349 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:02.044659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c47bf967-59c7-4a1c-8f99-08e28dbb6349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:02.074320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:02.142245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:02.444245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18410217-20c1-407b-b845-3ec8320d2f9d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:02.445820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-18410217-20c1-407b-b845-3ec8320d2f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:02.549275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18410217-20c1-407b-b845-3ec8320d2f9d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:02.578894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:02.625416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbf001-9198-4663-a2ff-39da8c93e1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:02.626018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf001-9198-4663-a2ff-39da8c93e1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:02.626322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf001-9198-4663-a2ff-39da8c93e1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:02.626589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbf001-9198-4663-a2ff-39da8c93e1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:02.628175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b7fbf001-9198-4663-a2ff-39da8c93e1a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:02.736297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbf001-9198-4663-a2ff-39da8c93e1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:02.737723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbf001-9198-4663-a2ff-39da8c93e1a5 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:02.755204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 738/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:04.952120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857879d0-50c5-4000-bca0-27673c4d05e8 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:04.952682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857879d0-50c5-4000-bca0-27673c4d05e8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:04.952682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857879d0-50c5-4000-bca0-27673c4d05e8 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:04.954009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:52:04.959387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c1f2-54f8-425b-8fe7-a94b60674953 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:04.959815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c1f2-54f8-425b-8fe7-a94b60674953 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:04.959937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c1f2-54f8-425b-8fe7-a94b60674953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:05.025653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7e62c1f2-54f8-425b-8fe7-a94b60674953 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:05.026875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7e62c1f2-54f8-425b-8fe7-a94b60674953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:05.035320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:05.123804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:05.407155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857879d0-50c5-4000-bca0-27673c4d05e8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:05.408688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-857879d0-50c5-4000-bca0-27673c4d05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:05.510037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857879d0-50c5-4000-bca0-27673c4d05e8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:05.566293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:05.585553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996e2e5-7b71-416f-a5e1-3e465fbf5418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:05.586179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996e2e5-7b71-416f-a5e1-3e465fbf5418 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:05.586458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996e2e5-7b71-416f-a5e1-3e465fbf5418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:05.586727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996e2e5-7b71-416f-a5e1-3e465fbf5418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:05.588315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7996e2e5-7b71-416f-a5e1-3e465fbf5418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:05.695678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996e2e5-7b71-416f-a5e1-3e465fbf5418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:05.697038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996e2e5-7b71-416f-a5e1-3e465fbf5418 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:05.715841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 722/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:07.904350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932df63-5ba1-4945-b1aa-99aacd23bfcd None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:07.904959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932df63-5ba1-4945-b1aa-99aacd23bfcd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:07.904959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932df63-5ba1-4945-b1aa-99aacd23bfcd None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:07.906562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:07.911963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83f33-c770-4a2c-b7bb-40d8c9976454 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:07.912433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83f33-c770-4a2c-b7bb-40d8c9976454 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:07.912537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc83f33-c770-4a2c-b7bb-40d8c9976454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:07.988255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7dc83f33-c770-4a2c-b7bb-40d8c9976454 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:07.989393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7dc83f33-c770-4a2c-b7bb-40d8c9976454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:08.033250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:08.094655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:08.379683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932df63-5ba1-4945-b1aa-99aacd23bfcd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:08.381229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a932df63-5ba1-4945-b1aa-99aacd23bfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:08.484681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932df63-5ba1-4945-b1aa-99aacd23bfcd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:08.522753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:08.559717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240601e-d54c-4725-bd92-5adb117fd726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:08.560513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240601e-d54c-4725-bd92-5adb117fd726 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:08.560892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240601e-d54c-4725-bd92-5adb117fd726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:08.561260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240601e-d54c-4725-bd92-5adb117fd726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:08.563509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0240601e-d54c-4725-bd92-5adb117fd726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:08.677923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240601e-d54c-4725-bd92-5adb117fd726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:08.679388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240601e-d54c-4725-bd92-5adb117fd726 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:08.697998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 741/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:10.926484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705669fd-816d-4dea-9907-ae0ba1fb5ca4 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:10.927041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705669fd-816d-4dea-9907-ae0ba1fb5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:10.927041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705669fd-816d-4dea-9907-ae0ba1fb5ca4 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:10.928347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:10.933557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43fb8-2cc1-4f75-8c65-a186b7febd7c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:10.933942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43fb8-2cc1-4f75-8c65-a186b7febd7c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:10.934108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43fb8-2cc1-4f75-8c65-a186b7febd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:11.000042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8fd43fb8-2cc1-4f75-8c65-a186b7febd7c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:11.001248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8fd43fb8-2cc1-4f75-8c65-a186b7febd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:11.018911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:11.100112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:11.384688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705669fd-816d-4dea-9907-ae0ba1fb5ca4 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:11.386270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-705669fd-816d-4dea-9907-ae0ba1fb5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:11.488238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705669fd-816d-4dea-9907-ae0ba1fb5ca4 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:11.554097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:11.561924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e4ba8-34e4-4704-9b93-60221c339e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:11.562549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4ba8-34e4-4704-9b93-60221c339e5c service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:11.562820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4ba8-34e4-4704-9b93-60221c339e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:11.563086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e4ba8-34e4-4704-9b93-60221c339e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:11.564651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6f3e4ba8-34e4-4704-9b93-60221c339e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:11.671827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e4ba8-34e4-4704-9b93-60221c339e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:11.673257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e4ba8-34e4-4704-9b93-60221c339e5c service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:11.694278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 725/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:13.858526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7bff5-423d-4aa0-855a-ce0d5d1761a5 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:13.859105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7bff5-423d-4aa0-855a-ce0d5d1761a5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:13.859105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7bff5-423d-4aa0-855a-ce0d5d1761a5 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:13.860399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:13.865790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff465-70c7-4cef-b44b-6b7de12ad2a8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:13.866225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff465-70c7-4cef-b44b-6b7de12ad2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:13.866361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ff465-70c7-4cef-b44b-6b7de12ad2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:13.932511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-362ff465-70c7-4cef-b44b-6b7de12ad2a8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:13.933707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-362ff465-70c7-4cef-b44b-6b7de12ad2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:13.980415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:14.029485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:14.309631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7bff5-423d-4aa0-855a-ce0d5d1761a5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:14.311229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e0d7bff5-423d-4aa0-855a-ce0d5d1761a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:14.413730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7bff5-423d-4aa0-855a-ce0d5d1761a5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:14.460732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:14.486438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76823530-f51d-49a8-81af-b7294df03ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:14.487069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823530-f51d-49a8-81af-b7294df03ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:14.487347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823530-f51d-49a8-81af-b7294df03ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:14.487621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823530-f51d-49a8-81af-b7294df03ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:14.489211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-76823530-f51d-49a8-81af-b7294df03ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:14.598796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76823530-f51d-49a8-81af-b7294df03ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:14.600150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76823530-f51d-49a8-81af-b7294df03ad0 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:14.618029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 744/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:24.027555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=22 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:24.615432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=66 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:34.651404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0732d9-f677-4db9-a2f0-5731b3fcad8e None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:34.651963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0732d9-f677-4db9-a2f0-5731b3fcad8e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:34.651963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0732d9-f677-4db9-a2f0-5731b3fcad8e None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:34.654007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 727/1471] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:34.659561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b751-2f11-4f4f-be4c-9be626f3568f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:34.659997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b751-2f11-4f4f-be4c-9be626f3568f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:34.660104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99b751-2f11-4f4f-be4c-9be626f3568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:34.727692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-eb99b751-2f11-4f4f-be4c-9be626f3568f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:34.728885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-eb99b751-2f11-4f4f-be4c-9be626f3568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:34.825615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 745/1472] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:35.126862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572e28-2342-42e1-a086-b97489f37bb7 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:35.127148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572e28-2342-42e1-a086-b97489f37bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:35.127422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63572e28-2342-42e1-a086-b97489f37bb7 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:35.128770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 728/1473] 10.222.0.52 () {54 vars in 966 bytes} [Fri Sep 9 14:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:35.133610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac0a3-4e0e-4136-bda7-e42de70ca65b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:35.133892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac0a3-4e0e-4136-bda7-e42de70ca65b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:35.134206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ac0a3-4e0e-4136-bda7-e42de70ca65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:35.210318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-242ac0a3-4e0e-4136-bda7-e42de70ca65b None None] MFA Rules not processed for user `3849cb5e321d48c88f0e19121ec7e1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:35.211516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-242ac0a3-4e0e-4136-bda7-e42de70ca65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:35.235521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:35.290766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 746/1474] 10.222.0.52 () {58 vars in 1063 bytes} [Fri Sep 9 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:35.299561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63572e28-2342-42e1-a086-b97489f37bb7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:35.301093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-63572e28-2342-42e1-a086-b97489f37bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:35.403815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63572e28-2342-42e1-a086-b97489f37bb7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:35.476550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f7891-f256-4c7b-a708-c30ec5958f3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3849cb5e321d48c88f0e19121ec7e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:35.477146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f7891-f256-4c7b-a708-c30ec5958f3e service glance] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:35.477422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f7891-f256-4c7b-a708-c30ec5958f3e service glance] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:35.477689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f7891-f256-4c7b-a708-c30ec5958f3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:35.479394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-674f7891-f256-4c7b-a708-c30ec5958f3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:35.533363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:35.587727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f7891-f256-4c7b-a708-c30ec5958f3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:35.589152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f7891-f256-4c7b-a708-c30ec5958f3e service glance] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:35.608470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 729/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:37.864559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b51d-7111-4b50-9495-7bedd05d801f None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:37.865273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b51d-7111-4b50-9495-7bedd05d801f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:37.865273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0b51d-7111-4b50-9495-7bedd05d801f None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:37.866478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 747/1476] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:37.871604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08a25-585a-49fe-99a6-89520918d507 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:37.872636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08a25-585a-49fe-99a6-89520918d507 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:37.872965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08a25-585a-49fe-99a6-89520918d507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:37.938946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-51f08a25-585a-49fe-99a6-89520918d507 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:37.940176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-51f08a25-585a-49fe-99a6-89520918d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:38.039498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 730/1477] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:38.317463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0b51d-7111-4b50-9495-7bedd05d801f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:38.318964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a6e0b51d-7111-4b50-9495-7bedd05d801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:38.445261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0b51d-7111-4b50-9495-7bedd05d801f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:38.495274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:38.539613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd03307-6ed9-4837-8dfd-c9e0dd394890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:38.540211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03307-6ed9-4837-8dfd-c9e0dd394890 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:38.540489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03307-6ed9-4837-8dfd-c9e0dd394890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:38.540761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd03307-6ed9-4837-8dfd-c9e0dd394890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:38.541394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd03307-6ed9-4837-8dfd-c9e0dd394890 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:38.543205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-8fd03307-6ed9-4837-8dfd-c9e0dd394890 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:52:38.543205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:52:38.543205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:52:38.545219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd03307-6ed9-4837-8dfd-c9e0dd394890 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:38.564921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 748/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Sep 9 14:52:38 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:52:40.733743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe88089-4e33-4371-9a41-570ce9e4a3a2 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:40.734302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe88089-4e33-4371-9a41-570ce9e4a3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:40.734484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe88089-4e33-4371-9a41-570ce9e4a3a2 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:40.735725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 731/1479] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:40.741098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4df4-5efb-433e-8eee-76224fb468b4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:40.741540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4df4-5efb-433e-8eee-76224fb468b4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:40.741650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4df4-5efb-433e-8eee-76224fb468b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:40.808548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-592c4df4-5efb-433e-8eee-76224fb468b4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:40.809955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-592c4df4-5efb-433e-8eee-76224fb468b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:40.904507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 749/1480] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:41.199053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe88089-4e33-4371-9a41-570ce9e4a3a2 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:41.201459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bbe88089-4e33-4371-9a41-570ce9e4a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:41.211336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:41.346251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe88089-4e33-4371-9a41-570ce9e4a3a2 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:41.424449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:41.456959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4199f-81b0-4caf-85b8-bd53176156d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:41.457487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4199f-81b0-4caf-85b8-bd53176156d1 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:41.457762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4199f-81b0-4caf-85b8-bd53176156d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:41.458030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4199f-81b0-4caf-85b8-bd53176156d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:41.459648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4ec4199f-81b0-4caf-85b8-bd53176156d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:41.547560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4199f-81b0-4caf-85b8-bd53176156d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:41.549131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4199f-81b0-4caf-85b8-bd53176156d1 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:41.567078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 732/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:43.913871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754f942-c013-4094-ad42-3f6a78ce52d1 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:43.914468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754f942-c013-4094-ad42-3f6a78ce52d1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:43.914468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754f942-c013-4094-ad42-3f6a78ce52d1 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:43.915832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 750/1482] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:43.921804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e447-5838-4a83-8ddb-9fa99691f24d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:43.922271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e447-5838-4a83-8ddb-9fa99691f24d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:43.922390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204e447-5838-4a83-8ddb-9fa99691f24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:43.991008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b204e447-5838-4a83-8ddb-9fa99691f24d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:43.992223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b204e447-5838-4a83-8ddb-9fa99691f24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:44.045160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:44.095485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 733/1483] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:44.382612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754f942-c013-4094-ad42-3f6a78ce52d1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:44.384176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c754f942-c013-4094-ad42-3f6a78ce52d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:44.409168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:44.488335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754f942-c013-4094-ad42-3f6a78ce52d1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:44.563298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c8130-9ffc-4324-99dd-2e97437af677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:44.563898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8130-9ffc-4324-99dd-2e97437af677 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:44.564172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8130-9ffc-4324-99dd-2e97437af677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:44.564439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8130-9ffc-4324-99dd-2e97437af677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:44.566015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d04c8130-9ffc-4324-99dd-2e97437af677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:44.640792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:44.675614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c8130-9ffc-4324-99dd-2e97437af677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:44.677043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c8130-9ffc-4324-99dd-2e97437af677 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:44.696189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 751/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:46.915317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70e5d-8f6d-4650-bfca-4ad08d64fdc9 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:46.915855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70e5d-8f6d-4650-bfca-4ad08d64fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:46.915962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd70e5d-8f6d-4650-bfca-4ad08d64fdc9 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:46.917234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 734/1485] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:46.922855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606c20-ba0a-4bf4-9e6f-c184992c9fd3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:46.923319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606c20-ba0a-4bf4-9e6f-c184992c9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:46.923425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606c20-ba0a-4bf4-9e6f-c184992c9fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:46.988550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f4606c20-ba0a-4bf4-9e6f-c184992c9fd3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:46.989743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f4606c20-ba0a-4bf4-9e6f-c184992c9fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:47.084970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 752/1486] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:47.375355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd70e5d-8f6d-4650-bfca-4ad08d64fdc9 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:47.376923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1bd70e5d-8f6d-4650-bfca-4ad08d64fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:47.478977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd70e5d-8f6d-4650-bfca-4ad08d64fdc9 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:47.551154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:47.552659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb4c2f-0055-4e4e-b40b-cd47c029968c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:47.553262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4c2f-0055-4e4e-b40b-cd47c029968c service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:47.553736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4c2f-0055-4e4e-b40b-cd47c029968c service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:47.554218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb4c2f-0055-4e4e-b40b-cd47c029968c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:47.555995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bafb4c2f-0055-4e4e-b40b-cd47c029968c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:47.664503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb4c2f-0055-4e4e-b40b-cd47c029968c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:47.665930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb4c2f-0055-4e4e-b40b-cd47c029968c service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:47.684557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 735/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:49.938756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192b2d-fd25-4bba-a78e-3d27ea2b2d40 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:49.939289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192b2d-fd25-4bba-a78e-3d27ea2b2d40 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:49.939289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192b2d-fd25-4bba-a78e-3d27ea2b2d40 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:49.940640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 753/1488] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:49.945991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5718-6265-4aca-9f27-5e9c671b1a12 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:49.946470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5718-6265-4aca-9f27-5e9c671b1a12 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:49.946567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb5718-6265-4aca-9f27-5e9c671b1a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:50.012796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-97eb5718-6265-4aca-9f27-5e9c671b1a12 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:50.013924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-97eb5718-6265-4aca-9f27-5e9c671b1a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:50.066951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:50.111288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 736/1489] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:50.407400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192b2d-fd25-4bba-a78e-3d27ea2b2d40 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:50.409005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-44192b2d-fd25-4bba-a78e-3d27ea2b2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:50.444643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:50.513625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192b2d-fd25-4bba-a78e-3d27ea2b2d40 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:50.587571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce6ae0-bd3f-46de-9fdd-5c08721a6530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:50.588173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6ae0-bd3f-46de-9fdd-5c08721a6530 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:50.588454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6ae0-bd3f-46de-9fdd-5c08721a6530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:50.588722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce6ae0-bd3f-46de-9fdd-5c08721a6530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:50.590362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d8ce6ae0-bd3f-46de-9fdd-5c08721a6530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:50.671047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:50.701915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce6ae0-bd3f-46de-9fdd-5c08721a6530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:50.703403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce6ae0-bd3f-46de-9fdd-5c08721a6530 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:50.721480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 754/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:52:53.079561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d652e-54b9-4e41-b882-51600ed4cfeb None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:53.080281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d652e-54b9-4e41-b882-51600ed4cfeb None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:53.080281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d652e-54b9-4e41-b882-51600ed4cfeb None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:53.081324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 737/1491] 10.222.0.52 () {54 vars in 927 bytes} [Fri Sep 9 14:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:52:53.086652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3800-fb3c-4c6d-bbe8-482d3fc11491 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:53.087053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3800-fb3c-4c6d-bbe8-482d3fc11491 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:53.087212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e3800-fb3c-4c6d-bbe8-482d3fc11491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:53.152948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-750e3800-fb3c-4c6d-bbe8-482d3fc11491 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:52:53.154185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-750e3800-fb3c-4c6d-bbe8-482d3fc11491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:53.250973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 755/1492] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Sep 9 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:52:53.539212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d652e-54b9-4e41-b882-51600ed4cfeb None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:52:53.540748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fa3d652e-54b9-4e41-b882-51600ed4cfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:53.648888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d652e-54b9-4e41-b882-51600ed4cfeb None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:52:53.723748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539df97c-ecc4-461a-80a3-fe275d908a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:52:53.724351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539df97c-ecc4-461a-80a3-fe275d908a66 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:52:53.724628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539df97c-ecc4-461a-80a3-fe275d908a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:52:53.724904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539df97c-ecc4-461a-80a3-fe275d908a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:52:53.726533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-539df97c-ecc4-461a-80a3-fe275d908a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:52:53.735640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:52:53.834989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539df97c-ecc4-461a-80a3-fe275d908a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:52:53.836350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539df97c-ecc4-461a-80a3-fe275d908a66 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:52:53.854523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 738/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:53:03.249401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=82 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:53:03.852188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=50 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:06.227608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:06.228184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:06.228184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:06.303841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:54:06.305059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:06.400485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 756/1494] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:54:06.408403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eb41b-d900-4282-a65b-0573d716ec7e None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:06.408907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eb41b-d900-4282-a65b-0573d716ec7e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:06.409014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eb41b-d900-4282-a65b-0573d716ec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:06.486812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-008eb41b-d900-4282-a65b-0573d716ec7e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:54:06.488007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-008eb41b-d900-4282-a65b-0573d716ec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:06.583576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 739/1495] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:54:06.588248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:06.589461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:06.601066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ab36d-5901-4f28-a0ca-eba4268ff348 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:06.662516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:06.696239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:06.696835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:06.697113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:06.697379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:06.698009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:54:06.698344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:06.699399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:06.699399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:54:06.699399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:54:06.700265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:06.711733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 757/1496] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:54:06.719987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eb41b-d900-4282-a65b-0573d716ec7e None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:06.728810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eb41b-d900-4282-a65b-0573d716ec7e None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:06.789943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:06.824416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:06.825010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:06.825289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:06.825560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:06.826236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:06.827957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING py.warnings [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:06.827957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: warnings.warn(msg) Sep 09 14:54:06.827957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: Sep 09 14:54:06.829151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:06.885327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 740/1497] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:54:06 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:54:06.889628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:06.891278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:06.924849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39b56f-2bc7-41e6-b9ec-fc23db1c1528 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:07.016595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:07.017184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:07.017455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:07.017719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:07.018368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:07.019375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:07.019375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:54:07.019375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:54:07.020557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:07.062365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 758/1498] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:54:06 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:54:07.066487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:07.068006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:07.130077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83536f93-d477-499e-be57-1994de78d5ac admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:07.213113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:07.224892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:07.225522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:07.225800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:07.226069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:07.226798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:07.227828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING py.warnings [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:07.227828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: warnings.warn(msg) Sep 09 14:54:07.227828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: Sep 09 14:54:07.228702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:07.241456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 741/1499] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:54:07.245660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:07.247220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:07.258558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30032e63-d623-4e47-9f03-dfd3f3044f4e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:07.283867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:07.354206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3c244-ab39-4644-b8d3-259e2113af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:07.354806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c244-ab39-4644-b8d3-259e2113af7c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:07.355084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c244-ab39-4644-b8d3-259e2113af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:07.355401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c244-ab39-4644-b8d3-259e2113af7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:07.356542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3c244-ab39-4644-b8d3-259e2113af7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:07.357559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-d7d3c244-ab39-4644-b8d3-259e2113af7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:07.357559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:54:07.357559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:54:07.358469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3c244-ab39-4644-b8d3-259e2113af7c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:07.370480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 759/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:54:07.374775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:07.376311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:07.410436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08f6c-89ea-4aa1-9ba3-ff34a7d8db17 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:07.504966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1283410-0291-42d1-bb20-22fccd5c324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:07.505549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283410-0291-42d1-bb20-22fccd5c324c admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:07.505827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283410-0291-42d1-bb20-22fccd5c324c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:07.506148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1283410-0291-42d1-bb20-22fccd5c324c admin admin] PATH_INFO: `/v3/projects/10ad197d35c049139951121fc2ca26ef/users/f8f1984e88cf4cb5b8d6925923ba5805/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:07.530574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1283410-0291-42d1-bb20-22fccd5c324c admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ad197d35c049139951121fc2ca26ef, user_id=f8f1984e88cf4cb5b8d6925923ba5805, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:07.531593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING py.warnings [None req-c1283410-0291-42d1-bb20-22fccd5c324c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:07.531593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: warnings.warn(msg) Sep 09 14:54:07.531593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: Sep 09 14:54:07.533522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1283410-0291-42d1-bb20-22fccd5c324c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:07.556280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 742/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:54:07 2022] PUT /identity/v3/projects/10ad197d35c049139951121fc2ca26ef/users/f8f1984e88cf4cb5b8d6925923ba5805/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:54:07.568681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47115e09-c4a8-4d7c-ab09-a74d34988e3c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:07.568987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47115e09-c4a8-4d7c-ab09-a74d34988e3c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:07.569260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47115e09-c4a8-4d7c-ab09-a74d34988e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:07.626263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-47115e09-c4a8-4d7c-ab09-a74d34988e3c None None] MFA Rules not processed for user `f8f1984e88cf4cb5b8d6925923ba5805`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:54:07.627448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-47115e09-c4a8-4d7c-ab09-a74d34988e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:07.707321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 760/1502] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:54:07.721068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dc71b-24a8-4efb-868a-4c5050ebb3aa None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:07.721350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dc71b-24a8-4efb-868a-4c5050ebb3aa None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:07.721622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dc71b-24a8-4efb-868a-4c5050ebb3aa None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:07.722985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 743/1503] 10.222.0.52 () {54 vars in 964 bytes} [Fri Sep 9 14:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:54:07.727716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9122-041c-46a7-87f9-dba51c3ed158 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:07.728000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9122-041c-46a7-87f9-dba51c3ed158 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:07.728272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e9122-041c-46a7-87f9-dba51c3ed158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:07.760443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:07.923485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9a0e9122-041c-46a7-87f9-dba51c3ed158 None None] MFA Rules not processed for user `23f4b0027d97468c9b6f73381eb76a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:54:07.924691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9a0e9122-041c-46a7-87f9-dba51c3ed158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:07.999699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 761/1504] 10.222.0.52 () {58 vars in 1061 bytes} [Fri Sep 9 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:54:08.007366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dc71b-24a8-4efb-868a-4c5050ebb3aa None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:08.008885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e10dc71b-24a8-4efb-868a-4c5050ebb3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:08.062795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:08.119101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dc71b-24a8-4efb-868a-4c5050ebb3aa None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:08.193267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:08.193906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:08.194220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:08.194495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:08.196101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:08.295981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:08.297324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:08.300736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:08.315732 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 744/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:54:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:54:08.364888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5c5e5-aba6-4919-841b-9e48422c1510 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:08.365295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5c5e5-aba6-4919-841b-9e48422c1510 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:08.365463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5c5e5-aba6-4919-841b-9e48422c1510 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:08.366753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 762/1506] 10.222.0.52 () {52 vars in 830 bytes} [Fri Sep 9 14:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:54:08.370524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:08.371918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:08.475909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ef0cf-a128-4b32-ae6f-f5e3b77270e6 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:08.575376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:08.576004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:08.576360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:08.576630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] PATH_INFO: `/v3/users/f8f1984e88cf4cb5b8d6925923ba5805` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:08.591229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f1984e88cf4cb5b8d6925923ba5805)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:08.592242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING py.warnings [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:08.592242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: warnings.warn(msg) Sep 09 14:54:08.592242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: Sep 09 14:54:08.593426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:08.616490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:08.662345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f1984e88cf4cb5b8d6925923ba5805'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:08.671925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f1984e88cf4cb5b8d6925923ba5805'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:08.672463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f1984e88cf4cb5b8d6925923ba5805'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:08.686837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f1984e88cf4cb5b8d6925923ba5805'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:08.711605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f1984e88cf4cb5b8d6925923ba5805'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:08.718412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 745/1507] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:54:08 2022] DELETE /identity/v3/users/f8f1984e88cf4cb5b8d6925923ba5805 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:54:08.722655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:08.722943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:08.723213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:08.780004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:54:08.781194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:08.864100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:08.877725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 763/1508] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:54:08.887252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:08.888480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:08.988152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cabc46-6ad4-4190-99e4-1a72080d7dae admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:09.042437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:09.065201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357f91d-b886-434d-ae9e-2beca2bbd611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:09.065802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357f91d-b886-434d-ae9e-2beca2bbd611 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:09.066075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357f91d-b886-434d-ae9e-2beca2bbd611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:09.066367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357f91d-b886-434d-ae9e-2beca2bbd611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:09.067938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1357f91d-b886-434d-ae9e-2beca2bbd611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:09.180679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357f91d-b886-434d-ae9e-2beca2bbd611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:09.182127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357f91d-b886-434d-ae9e-2beca2bbd611 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:09.201476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 746/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:54:09.531789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:54:09.533036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:54:09.544828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0652c5-5a7c-48d0-825e-b65eb3aece3d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:54:09.647711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:54:09.648334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:54:09.648612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:54:09.648883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] PATH_INFO: `/v3/projects/10ad197d35c049139951121fc2ca26ef` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:54:09.659384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ad197d35c049139951121fc2ca26ef)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:54:09.660406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:54:09.660406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:54:09.660406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:54:09.661586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:54:09.722112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ad197d35c049139951121fc2ca26ef', 'request_id': 'req-f15e7067-06c8-45d5-b104-2cb3ed4929fa'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:09.728048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ad197d35c049139951121fc2ca26ef', 'request_id': 'req-f15e7067-06c8-45d5-b104-2cb3ed4929fa'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:09.741226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ad197d35c049139951121fc2ca26ef', 'request_id': 'req-f15e7067-06c8-45d5-b104-2cb3ed4929fa'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:09.766594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] The token cache is being invalidate because project 10ad197d35c049139951121fc2ca26ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:54:09.766884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:09.767311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f15e7067-06c8-45d5-b104-2cb3ed4929fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:54:09.768695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 764/1510] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:54:09 2022] DELETE /identity/v3/projects/10ad197d35c049139951121fc2ca26ef => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:54:19.198264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=62 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:54:19.764617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:55:43.999484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b715e-7cde-4b43-a629-475e9aacdb5f None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:44.000083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b715e-7cde-4b43-a629-475e9aacdb5f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:44.000083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b715e-7cde-4b43-a629-475e9aacdb5f None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:44.001309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:55:44.006026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c8a4d-374a-460f-a56d-8669744489dc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:44.006497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c8a4d-374a-460f-a56d-8669744489dc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:44.006610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c8a4d-374a-460f-a56d-8669744489dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:44.085344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-006c8a4d-374a-460f-a56d-8669744489dc None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:55:44.086636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-006c8a4d-374a-460f-a56d-8669744489dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:55:44.188467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:55:44.340704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b715e-7cde-4b43-a629-475e9aacdb5f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:55:44.342937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0d3b715e-7cde-4b43-a629-475e9aacdb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:55:44.459208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b715e-7cde-4b43-a629-475e9aacdb5f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:55:44.464715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c0f26-8700-4c64-af21-0c177c235512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:55:44.465318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c0f26-8700-4c64-af21-0c177c235512 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:44.465600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c0f26-8700-4c64-af21-0c177c235512 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:44.465879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c0f26-8700-4c64-af21-0c177c235512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:44.474521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c0f26-8700-4c64-af21-0c177c235512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:55:44.476101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c0f26-8700-4c64-af21-0c177c235512 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:55:44.486041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 748/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:55:45.549763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667ab1-a436-41f3-ac4c-7e899d33a654 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:45.550359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667ab1-a436-41f3-ac4c-7e899d33a654 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:45.550359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db667ab1-a436-41f3-ac4c-7e899d33a654 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:45.551685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:55:45.557880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782494-6e87-4462-b4aa-d6e89bf86390 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:45.558324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782494-6e87-4462-b4aa-d6e89bf86390 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:45.558528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782494-6e87-4462-b4aa-d6e89bf86390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:45.578596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-19782494-6e87-4462-b4aa-d6e89bf86390 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:55:45.579801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-19782494-6e87-4462-b4aa-d6e89bf86390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:55:45.587935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:55:45.740827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db667ab1-a436-41f3-ac4c-7e899d33a654 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:55:45.756172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db667ab1-a436-41f3-ac4c-7e899d33a654 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:55:45.761859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26b431-1d38-42b0-955e-5456280b2e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:55:45.762474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b431-1d38-42b0-955e-5456280b2e6b service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:45.762750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b431-1d38-42b0-955e-5456280b2e6b service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:45.763016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26b431-1d38-42b0-955e-5456280b2e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:45.771795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26b431-1d38-42b0-955e-5456280b2e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:55:45.773394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26b431-1d38-42b0-955e-5456280b2e6b service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:55:45.782993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 767/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:55:45.936111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538754f-ecf4-497b-8252-89456cb19cfb None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:45.936400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538754f-ecf4-497b-8252-89456cb19cfb None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:45.936680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538754f-ecf4-497b-8252-89456cb19cfb None None] PATH_INFO: `/v3` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:45.937991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 750/1517] 10.222.0.33 () {54 vars in 925 bytes} [Fri Sep 9 14:55:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:55:45.945885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9447a-1d9e-4f04-ad2d-7bbc3827a127 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:45.946199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9447a-1d9e-4f04-ad2d-7bbc3827a127 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:45.946610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9447a-1d9e-4f04-ad2d-7bbc3827a127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:46.006938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9db9447a-1d9e-4f04-ad2d-7bbc3827a127 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:55:46.008119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9db9447a-1d9e-4f04-ad2d-7bbc3827a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:55:46.024386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:55:46.080517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 768/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 9 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:55:54.854351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fabf8-5cba-4e4d-9e4f-01e43c6c8cca None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:54.854786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fabf8-5cba-4e4d-9e4f-01e43c6c8cca None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:54.854892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6fabf8-5cba-4e4d-9e4f-01e43c6c8cca None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:54.856228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 751/1519] 10.222.0.52 () {54 vars in 961 bytes} [Fri Sep 9 14:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:55:54.861096 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc52e1-d578-4a1f-8089-f5ef71600ae7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:54.861528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc52e1-d578-4a1f-8089-f5ef71600ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:54.861631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc52e1-d578-4a1f-8089-f5ef71600ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:54.881268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-23bc52e1-d578-4a1f-8089-f5ef71600ae7 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:55:54.882414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-23bc52e1-d578-4a1f-8089-f5ef71600ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:55:54.892041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 769/1520] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Sep 9 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:55:54.898924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fabf8-5cba-4e4d-9e4f-01e43c6c8cca None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:55:54.912352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6fabf8-5cba-4e4d-9e4f-01e43c6c8cca None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:55:54.917375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde6db9-7324-4221-a82e-39671c308407 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:55:54.918041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde6db9-7324-4221-a82e-39671c308407 service placement] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:54.918360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde6db9-7324-4221-a82e-39671c308407 service placement] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:54.918636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde6db9-7324-4221-a82e-39671c308407 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:54.928016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde6db9-7324-4221-a82e-39671c308407 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:55:54.930472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde6db9-7324-4221-a82e-39671c308407 service placement] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:55:54.947333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 752/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:55:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:55:57.277771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898df55-0422-4ea1-b556-93cff285438c None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:57.278397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898df55-0422-4ea1-b556-93cff285438c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:57.278397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898df55-0422-4ea1-b556-93cff285438c None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:57.279663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:55:57.285896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767bae0-f65f-43bd-8aee-7662ea83597b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:57.286363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767bae0-f65f-43bd-8aee-7662ea83597b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:57.286488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767bae0-f65f-43bd-8aee-7662ea83597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:57.305526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1767bae0-f65f-43bd-8aee-7662ea83597b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:55:57.306754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1767bae0-f65f-43bd-8aee-7662ea83597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:55:57.315145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:55:57.467839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898df55-0422-4ea1-b556-93cff285438c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:55:57.482578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898df55-0422-4ea1-b556-93cff285438c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:55:57.488898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7f945-1f00-4e8a-a68e-31a2a78fc0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:55:57.489483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f945-1f00-4e8a-a68e-31a2a78fc0f4 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:57.489758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f945-1f00-4e8a-a68e-31a2a78fc0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:57.490026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f945-1f00-4e8a-a68e-31a2a78fc0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:57.497967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7f945-1f00-4e8a-a68e-31a2a78fc0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:55:57.499560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7f945-1f00-4e8a-a68e-31a2a78fc0f4 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:55:57.509470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 771/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:55:58.574422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5a21-7eaf-4986-a7dd-aa260e7fad4d None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:58.574967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5a21-7eaf-4986-a7dd-aa260e7fad4d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:58.574967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5a21-7eaf-4986-a7dd-aa260e7fad4d None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:58.576309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 14:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:55:58.582889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d825da-d60f-43ed-8204-0c02cf991c05 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:58.583350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d825da-d60f-43ed-8204-0c02cf991c05 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:58.583467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d825da-d60f-43ed-8204-0c02cf991c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:58.603033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-76d825da-d60f-43ed-8204-0c02cf991c05 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:55:58.604213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-76d825da-d60f-43ed-8204-0c02cf991c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:55:58.612761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:55:58.764960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5a21-7eaf-4986-a7dd-aa260e7fad4d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:55:58.779478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5a21-7eaf-4986-a7dd-aa260e7fad4d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:55:58.785756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a20a0-fa9a-4975-a581-6de6f4a5e91c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:55:58.786377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a20a0-fa9a-4975-a581-6de6f4a5e91c service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:55:58.786655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a20a0-fa9a-4975-a581-6de6f4a5e91c service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:55:58.786920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a20a0-fa9a-4975-a581-6de6f4a5e91c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:55:58.794819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a20a0-fa9a-4975-a581-6de6f4a5e91c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:55:58.796371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a20a0-fa9a-4975-a581-6de6f4a5e91c service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:55:58.806522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 755/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:56:02.806992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd10d22-39b2-4c52-aecb-159c1763a1e6 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:02.807561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd10d22-39b2-4c52-aecb-159c1763a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:02.807561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd10d22-39b2-4c52-aecb-159c1763a1e6 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:02.808944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:56:02.814072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123c7d-ba5b-4dc8-bef2-8a78aee7efad None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:02.814556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123c7d-ba5b-4dc8-bef2-8a78aee7efad None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:02.814668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123c7d-ba5b-4dc8-bef2-8a78aee7efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:02.834367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-46123c7d-ba5b-4dc8-bef2-8a78aee7efad None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:56:02.835544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-46123c7d-ba5b-4dc8-bef2-8a78aee7efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:56:02.843206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:56:03.137989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd10d22-39b2-4c52-aecb-159c1763a1e6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:56:03.139726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-acd10d22-39b2-4c52-aecb-159c1763a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:56:03.218730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd10d22-39b2-4c52-aecb-159c1763a1e6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:56:03.222519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46611-d461-4d50-8831-277d58bdb405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:56:03.223120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46611-d461-4d50-8831-277d58bdb405 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:03.223404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46611-d461-4d50-8831-277d58bdb405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:03.223680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46611-d461-4d50-8831-277d58bdb405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:03.232618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46611-d461-4d50-8831-277d58bdb405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:56:03.234055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46611-d461-4d50-8831-277d58bdb405 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:56:03.243424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 774/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:56:05.375949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30d9c7-a5a0-4a07-a6d8-11ffa8ceac1a None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:05.376522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30d9c7-a5a0-4a07-a6d8-11ffa8ceac1a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:05.376522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30d9c7-a5a0-4a07-a6d8-11ffa8ceac1a None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:05.377968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:56:05.383372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae38b9-7252-47a8-bf02-a9c70902a5fc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:05.384089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae38b9-7252-47a8-bf02-a9c70902a5fc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:05.384299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae38b9-7252-47a8-bf02-a9c70902a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:05.405370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0cae38b9-7252-47a8-bf02-a9c70902a5fc None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:56:05.406601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0cae38b9-7252-47a8-bf02-a9c70902a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:56:05.415100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:56:05.702341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30d9c7-a5a0-4a07-a6d8-11ffa8ceac1a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:56:05.713937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30d9c7-a5a0-4a07-a6d8-11ffa8ceac1a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:56:05.717402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbcc92-ba28-479b-afc0-a18bb535e4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:56:05.717991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbcc92-ba28-479b-afc0-a18bb535e4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:05.718301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbcc92-ba28-479b-afc0-a18bb535e4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:05.718574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbcc92-ba28-479b-afc0-a18bb535e4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:05.728009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbcc92-ba28-479b-afc0-a18bb535e4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:56:05.729437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbcc92-ba28-479b-afc0-a18bb535e4b5 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:56:05.738808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 758/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:56:09.543385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1b03-02d9-41c8-be75-bfab646adc27 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:09.543958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1b03-02d9-41c8-be75-bfab646adc27 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:09.543958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d1b03-02d9-41c8-be75-bfab646adc27 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:09.545245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:56:09.551109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca042e9-73f9-4534-8186-9c79c8d8ae8a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:09.551554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca042e9-73f9-4534-8186-9c79c8d8ae8a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:09.551654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca042e9-73f9-4534-8186-9c79c8d8ae8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:09.559183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=81 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:56:09.572379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6ca042e9-73f9-4534-8186-9c79c8d8ae8a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:56:09.573559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6ca042e9-73f9-4534-8186-9c79c8d8ae8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:56:09.581643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:56:09.882397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1b03-02d9-41c8-be75-bfab646adc27 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:56:09.884063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dc9d1b03-02d9-41c8-be75-bfab646adc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:56:09.948301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:56:09.962330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d1b03-02d9-41c8-be75-bfab646adc27 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:56:09.965815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247acc87-f6a0-48dc-b32f-e68df85fc785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:56:09.966462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247acc87-f6a0-48dc-b32f-e68df85fc785 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:09.966743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247acc87-f6a0-48dc-b32f-e68df85fc785 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:09.967014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247acc87-f6a0-48dc-b32f-e68df85fc785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:09.975810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247acc87-f6a0-48dc-b32f-e68df85fc785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:56:09.977234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247acc87-f6a0-48dc-b32f-e68df85fc785 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:56:09.986587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 777/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:56:12.113423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dcf93-239b-4970-93e0-17f0f62bd701 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:12.114002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dcf93-239b-4970-93e0-17f0f62bd701 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:12.114002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dcf93-239b-4970-93e0-17f0f62bd701 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:12.115404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 14:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:56:12.120488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992859b2-04d2-41a1-8a01-ce075b78a326 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:12.120960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992859b2-04d2-41a1-8a01-ce075b78a326 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:12.121071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992859b2-04d2-41a1-8a01-ce075b78a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:12.140953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-992859b2-04d2-41a1-8a01-ce075b78a326 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:56:12.142725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-992859b2-04d2-41a1-8a01-ce075b78a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:56:12.150781 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:56:12.448747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dcf93-239b-4970-93e0-17f0f62bd701 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:56:12.450430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3a4dcf93-239b-4970-93e0-17f0f62bd701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:56:12.463974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dcf93-239b-4970-93e0-17f0f62bd701 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:56:12.467488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fe8c4-d6b0-401f-bdb6-23f293047a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:56:12.468074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe8c4-d6b0-401f-bdb6-23f293047a96 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:56:12.468349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe8c4-d6b0-401f-bdb6-23f293047a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:56:12.468616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fe8c4-d6b0-401f-bdb6-23f293047a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:56:12.477913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe8c4-d6b0-401f-bdb6-23f293047a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:56:12.479359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fe8c4-d6b0-401f-bdb6-23f293047a96 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:56:12.488694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 761/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:56:22.136085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=11 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:56:22.484388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=8 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:44.706435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16d02-bdbf-4f27-a52f-496c35815ce6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.707390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16d02-bdbf-4f27-a52f-496c35815ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.707390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d16d02-bdbf-4f27-a52f-496c35815ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.740246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-66d16d02-bdbf-4f27-a52f-496c35815ce6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:44.741872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-66d16d02-bdbf-4f27-a52f-496c35815ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:44.761194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 779/1540] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:44.770780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc5400-f901-447c-a6c4-9a285d1979e2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.772019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc5400-f901-447c-a6c4-9a285d1979e2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.772534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc5400-f901-447c-a6c4-9a285d1979e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.783181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb300-5d79-4488-9faf-6f72f1571207 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.783558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb300-5d79-4488-9faf-6f72f1571207 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.783792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb300-5d79-4488-9faf-6f72f1571207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.808157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b4dc5400-f901-447c-a6c4-9a285d1979e2 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:44.809808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b4dc5400-f901-447c-a6c4-9a285d1979e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:44.814357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0e7cb300-5d79-4488-9faf-6f72f1571207 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:44.816316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0e7cb300-5d79-4488-9faf-6f72f1571207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:44.825223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 762/1541] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:44.826954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730ad5e-8034-408f-a55c-907215b5a8bd None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.827480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730ad5e-8034-408f-a55c-907215b5a8bd None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.827980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730ad5e-8034-408f-a55c-907215b5a8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.835498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 780/1542] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:44.836371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cb300-5d79-4488-9faf-6f72f1571207 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:44.852684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cb300-5d79-4488-9faf-6f72f1571207 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:44.866734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ca3b-b326-4c61-9d2f-291cd54f9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:44.867293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f730ad5e-8034-408f-a55c-907215b5a8bd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:44.867667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ca3b-b326-4c61-9d2f-291cd54f9def admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.868122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ca3b-b326-4c61-9d2f-291cd54f9def admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.868581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ca3b-b326-4c61-9d2f-291cd54f9def admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.869154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f730ad5e-8034-408f-a55c-907215b5a8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:44.869432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ca3b-b326-4c61-9d2f-291cd54f9def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:44.869744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ca3b-b326-4c61-9d2f-291cd54f9def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:44.871446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ca3b-b326-4c61-9d2f-291cd54f9def admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:44.884161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 763/1543] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:44.886713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eca81-e1cb-472e-8cce-e2b74ad4e08f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.887707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eca81-e1cb-472e-8cce-e2b74ad4e08f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.888216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eca81-e1cb-472e-8cce-e2b74ad4e08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.891549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 781/1544] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:44.898525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9a62-0ae5-4220-bc0c-e7b277fff266 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.898806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9a62-0ae5-4220-bc0c-e7b277fff266 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.899281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e9a62-0ae5-4220-bc0c-e7b277fff266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.923814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ef8eca81-e1cb-472e-8cce-e2b74ad4e08f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:44.925357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ef8eca81-e1cb-472e-8cce-e2b74ad4e08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:44.942198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f69e9a62-0ae5-4220-bc0c-e7b277fff266 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:44.942198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f69e9a62-0ae5-4220-bc0c-e7b277fff266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:44.944273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 764/1545] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:44.945440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eca81-e1cb-472e-8cce-e2b74ad4e08f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:44.957365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eca81-e1cb-472e-8cce-e2b74ad4e08f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:44.961468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 782/1546] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:44.962533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9a62-0ae5-4220-bc0c-e7b277fff266 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:44.970612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:44.971752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.972389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.972901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.973755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:44.975950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:44.977161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e9a62-0ae5-4220-bc0c-e7b277fff266 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:44.991887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:44.992511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:44.992793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:44.993064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:44.993718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:44.994021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:44.996168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.020012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 783/1547] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:45.021004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.036937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d933193-fe74-4aea-888e-4516bb22ec63 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.047254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 765/1548] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:44 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.048172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.050275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.050911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.051195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.051472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.052530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:45.052839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.054501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.078472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 784/1549] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:45.079380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.095802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f5e3-878a-440a-867b-d615d0aa216c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.173600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374e35e-1b96-4489-ade9-2e549ceae6b4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.179822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67d11-fbe2-46f6-a760-de3f395d4d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.180759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67d11-fbe2-46f6-a760-de3f395d4d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.181035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67d11-fbe2-46f6-a760-de3f395d4d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.181462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67d11-fbe2-46f6-a760-de3f395d4d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.182119 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca67d11-fbe2-46f6-a760-de3f395d4d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.184039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca67d11-fbe2-46f6-a760-de3f395d4d7c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.187664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2094015-7191-4538-af99-706320504498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.188277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094015-7191-4538-af99-706320504498 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.188636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094015-7191-4538-af99-706320504498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.188943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2094015-7191-4538-af99-706320504498 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.189645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2094015-7191-4538-af99-706320504498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.192256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2094015-7191-4538-af99-706320504498 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.218612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 785/1550] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.219418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2094015-7191-4538-af99-706320504498 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.221046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 766/1551] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.222613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96c40-8997-482a-b1b1-c0fd829e9fb3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.222886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96c40-8997-482a-b1b1-c0fd829e9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.223160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d96c40-8997-482a-b1b1-c0fd829e9fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.232224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2094015-7191-4538-af99-706320504498 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.242949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e4d96c40-8997-482a-b1b1-c0fd829e9fb3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.244149 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e4d96c40-8997-482a-b1b1-c0fd829e9fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.290756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dbb78-ba6c-4ea8-b8d5-bce85ceb3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.291371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbb78-ba6c-4ea8-b8d5-bce85ceb3b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.291661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbb78-ba6c-4ea8-b8d5-bce85ceb3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.291928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbb78-ba6c-4ea8-b8d5-bce85ceb3b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.292555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dbb78-ba6c-4ea8-b8d5-bce85ceb3b99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.293611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-1d8dbb78-ba6c-4ea8-b8d5-bce85ceb3b99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:57:45.293611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:57:45.293611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:57:45.294831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dbb78-ba6c-4ea8-b8d5-bce85ceb3b99 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.304102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 767/1552] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.305536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb985-8c01-4174-a6ba-dd62a9e33fa5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.305835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb985-8c01-4174-a6ba-dd62a9e33fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.306117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbb985-8c01-4174-a6ba-dd62a9e33fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.323471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 786/1553] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.324582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b565d-4e49-4697-aea3-24c3b9f2fa4b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.324869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b565d-4e49-4697-aea3-24c3b9f2fa4b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.325141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b565d-4e49-4697-aea3-24c3b9f2fa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.326994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9bcbb985-8c01-4174-a6ba-dd62a9e33fa5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.328198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9bcbb985-8c01-4174-a6ba-dd62a9e33fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.345123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6f8b565d-4e49-4697-aea3-24c3b9f2fa4b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.346716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6f8b565d-4e49-4697-aea3-24c3b9f2fa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.356634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:45.359157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:45.389969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 768/1554] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.391311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d7c80-53a6-4cc4-b536-58ea6adf7027 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.391600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d7c80-53a6-4cc4-b536-58ea6adf7027 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.391870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d7c80-53a6-4cc4-b536-58ea6adf7027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.412985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 787/1555] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.413462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-315d7c80-53a6-4cc4-b536-58ea6adf7027 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.414261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec579-dbe3-4523-bd88-66ed9b4d8eaa None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.414550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec579-dbe3-4523-bd88-66ed9b4d8eaa None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.414765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-315d7c80-53a6-4cc4-b536-58ea6adf7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.414882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec579-dbe3-4523-bd88-66ed9b4d8eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.423095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 769/1556] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.423952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d7c80-53a6-4cc4-b536-58ea6adf7027 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.434163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d7c80-53a6-4cc4-b536-58ea6adf7027 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.435238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-929ec579-dbe3-4523-bd88-66ed9b4d8eaa None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.436420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-929ec579-dbe3-4523-bd88-66ed9b4d8eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.439039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70664409-776f-4aa5-be8f-13116a6bc257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.439650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664409-776f-4aa5-be8f-13116a6bc257 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.439989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664409-776f-4aa5-be8f-13116a6bc257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.440767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70664409-776f-4aa5-be8f-13116a6bc257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.441416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70664409-776f-4aa5-be8f-13116a6bc257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.443100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70664409-776f-4aa5-be8f-13116a6bc257 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.445248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 788/1557] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.445994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec579-dbe3-4523-bd88-66ed9b4d8eaa None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.455435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ec579-dbe3-4523-bd88-66ed9b4d8eaa None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.460316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 770/1558] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:45.461499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049009d1-41c2-45e2-be92-e213a446b08d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.461857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049009d1-41c2-45e2-be92-e213a446b08d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.462248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049009d1-41c2-45e2-be92-e213a446b08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.463713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.464307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.464583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.464850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.465472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.467416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.483992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-049009d1-41c2-45e2-be92-e213a446b08d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.485397 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-049009d1-41c2-45e2-be92-e213a446b08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.490013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 789/1559] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.490013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.494817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 771/1560] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.495947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec9fb-9ced-4fb8-aad1-29d0e096cfeb None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.496303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec9fb-9ced-4fb8-aad1-29d0e096cfeb None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.496650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec9fb-9ced-4fb8-aad1-29d0e096cfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.503296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60053904-11b4-43f8-8708-8f9e8ab8110f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.508147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ba7b9-4104-4f32-b8dc-74288716e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.508746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba7b9-4104-4f32-b8dc-74288716e999 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.509053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba7b9-4104-4f32-b8dc-74288716e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.509345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ba7b9-4104-4f32-b8dc-74288716e999 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.509963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba7b9-4104-4f32-b8dc-74288716e999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.511936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ba7b9-4104-4f32-b8dc-74288716e999 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.515753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e30ec9fb-9ced-4fb8-aad1-29d0e096cfeb None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.516937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e30ec9fb-9ced-4fb8-aad1-29d0e096cfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.525624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 772/1561] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.526972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b76fd6-356a-43d5-9990-7691a7591a5f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.527257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b76fd6-356a-43d5-9990-7691a7591a5f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.527538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b76fd6-356a-43d5-9990-7691a7591a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.538780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 790/1562] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.540114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05df5-0221-4fe5-9fbe-6e7aafa8b257 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.540400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05df5-0221-4fe5-9fbe-6e7aafa8b257 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.540677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05df5-0221-4fe5-9fbe-6e7aafa8b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.548778 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-97b76fd6-356a-43d5-9990-7691a7591a5f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.550469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-97b76fd6-356a-43d5-9990-7691a7591a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.558423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 773/1563] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.559576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f78ac3-b632-4011-a76a-27a7ff82cee5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.559850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f78ac3-b632-4011-a76a-27a7ff82cee5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.560115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f78ac3-b632-4011-a76a-27a7ff82cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.560399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f3e05df5-0221-4fe5-9fbe-6e7aafa8b257 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.561589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f3e05df5-0221-4fe5-9fbe-6e7aafa8b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.569719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 791/1564] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.570758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05df5-0221-4fe5-9fbe-6e7aafa8b257 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.580314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05df5-0221-4fe5-9fbe-6e7aafa8b257 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.584226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a7f78ac3-b632-4011-a76a-27a7ff82cee5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:45.585400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a7f78ac3-b632-4011-a76a-27a7ff82cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:45.586115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.586711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.586992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.587260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.587897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.589482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.593224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 774/1565] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:45.598420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f78ac3-b632-4011-a76a-27a7ff82cee5 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.601040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 792/1566] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:45.601812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.607726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f78ac3-b632-4011-a76a-27a7ff82cee5 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.611876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afe65c-26fe-4e47-8a8a-36fbac2df004 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.612452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.613172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.613446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.613749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.614381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.615953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.617006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.617612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.617925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.618254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.618891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:45.619198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.620764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.626019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 775/1567] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:45.626827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.634783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 793/1568] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:45.635588 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.637804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884addad-6451-4b7d-bbff-be1a5725788c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.645140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.645738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.645860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b54d-3813-4620-a44c-fe9594eaa316 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.646016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.646447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.647095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:45.647400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.648415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING py.warnings [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:57:45.648415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: warnings.warn(msg) Sep 09 14:57:45.648415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: Sep 09 14:57:45.649328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.650420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.651024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.651296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.651563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.652186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.653768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.669163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 776/1569] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:45.669163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.669467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 794/1570] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:45.669467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.673428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f4af-9a08-44d4-ba88-ca1d5b6033a6 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.678304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.678897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.679179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.679450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.679674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2733692-dd85-4a2c-8dc4-f200a4423e3e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.680087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:45.680389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.681975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.684589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.684892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.685167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.685436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.686064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:45.686442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.688025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.694312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 777/1571] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:45.695973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.707752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88223a1e-dc23-4053-9e0a-b28be359681f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.708775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 795/1572] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:45.709498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.713046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.713653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.713931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.714235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.714873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:45.715175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.716772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.720516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fd675-bed1-4815-b2a1-db5cee8da5fa admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.725561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.726235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.726510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.726777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] PATH_INFO: `/v3/projects/9824ee10a1cb45f598bb2a1873e7a331/users/b12eee6f7bee44c6a2cb31de030e0e4d/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.728953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 778/1573] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:45.729777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.739540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820f5ae-2f65-411a-9f06-171715df68e1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.742613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9824ee10a1cb45f598bb2a1873e7a331, user_id=b12eee6f7bee44c6a2cb31de030e0e4d, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.743659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:57:45.743659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:57:45.743659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:57:45.744684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.745273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.745551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.745650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.745821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.746483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.748049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.759259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 779/1574] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:45.760035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.762168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 796/1575] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:45 2022] PUT /identity/v3/projects/9824ee10a1cb45f598bb2a1873e7a331/users/b12eee6f7bee44c6a2cb31de030e0e4d/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:45.763060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.773942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d15deb-0861-4fc3-adb2-3b2b38d1c763 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.820848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:45.827077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2fb81-32f8-445e-aeca-bc42d63c7e82 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.831675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.832493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.832649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.832811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.833084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.833190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.833359 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.833658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.833765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.834315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.835647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.835931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.845654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 797/1576] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:45.846956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.856765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c12a0-b45f-474c-9e6c-7348f397b883 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.863575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.864172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.864449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.864719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.865343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.867284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.871031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 780/1577] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.871031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.891630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:45.895340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 798/1578] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.896137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.942025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0146c8-2dd1-441b-a76d-e5c8e7a81c80 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.961088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2e80-e7f9-46c2-ac81-67b36cae741c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:45.965564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:45.966193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:45.966472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:45.966737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:45.967351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:45.969274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:45.997809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 799/1579] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:45.998653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:45.999883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.000501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.000769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.001305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.001934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.004785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.034010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 781/1580] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:46.034010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.063317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4574d-0033-4c8d-bd4a-1da7a8becb0e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.093983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74012c3-8482-4741-a78c-c0d17f743bd9 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.099871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7d039-6d66-4ed8-9650-94cb4f500192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.100813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7d039-6d66-4ed8-9650-94cb4f500192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.101216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7d039-6d66-4ed8-9650-94cb4f500192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.101622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7d039-6d66-4ed8-9650-94cb4f500192 admin admin] PATH_INFO: `/v3/projects/b6cede85471c4bb4a029660cebc02f4f/users/8921841b7820412ca2691c0db6711f9f/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.116797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7d039-6d66-4ed8-9650-94cb4f500192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cede85471c4bb4a029660cebc02f4f, user_id=8921841b7820412ca2691c0db6711f9f, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.119608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7d039-6d66-4ed8-9650-94cb4f500192 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.120720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.121319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.121595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.121869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.122518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.124418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.130751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:46.134329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 782/1581] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:46 2022] PUT /identity/v3/projects/b6cede85471c4bb4a029660cebc02f4f/users/8921841b7820412ca2691c0db6711f9f/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:46.136101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b043-f419-478f-b6c6-03c60ff46daa None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.136388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b043-f419-478f-b6c6-03c60ff46daa None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.136682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b043-f419-478f-b6c6-03c60ff46daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.156975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 800/1582] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:45 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:46.157260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3b23b043-f419-478f-b6c6-03c60ff46daa None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:46.157775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.158582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3b23b043-f419-478f-b6c6-03c60ff46daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:46.185007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:46.223596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 783/1583] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:46.223596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b043-f419-478f-b6c6-03c60ff46daa None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.223894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88893d5-15f8-4b64-9978-55b8bde2f708 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.227682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.228348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.228624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.228890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] PATH_INFO: `/v3/projects/7bffc60229a14ecfa5ef5698300ccd7c/users/507a05e50d1345d498bb0f06fe4ef2df/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.230991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b043-f419-478f-b6c6-03c60ff46daa None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.235592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.236182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.236462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.237276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.237906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.238955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING py.warnings [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:57:46.238955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: warnings.warn(msg) Sep 09 14:57:46.238955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: Sep 09 14:57:46.240154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.244977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bffc60229a14ecfa5ef5698300ccd7c, user_id=507a05e50d1345d498bb0f06fe4ef2df, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.247648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.262075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 801/1584] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:46 2022] PUT /identity/v3/projects/7bffc60229a14ecfa5ef5698300ccd7c/users/507a05e50d1345d498bb0f06fe4ef2df/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:46.265902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.266027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 784/1585] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:46.266027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.273952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6535c9b-a756-4b7d-8552-f3a0cb4d9625 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.327984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf5d49-0db6-4f6c-8e72-a61e9a7fd752 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.330060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.331491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.331927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.332556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.333183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.333739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ef0a-ce61-4fcf-922c-977b7b547779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.334371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ef0a-ce61-4fcf-922c-977b7b547779 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.334650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ef0a-ce61-4fcf-922c-977b7b547779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.334918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ef0a-ce61-4fcf-922c-977b7b547779 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.335148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.335534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0ef0a-ce61-4fcf-922c-977b7b547779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.337416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0ef0a-ce61-4fcf-922c-977b7b547779 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.358396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 785/1586] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:46.359288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.363528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 802/1587] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:46.363528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fc5db-7803-40fd-8848-73eba2d8de2f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.363528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fc5db-7803-40fd-8848-73eba2d8de2f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.363528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fc5db-7803-40fd-8848-73eba2d8de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.369246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a57851-1d35-49d0-91b1-31ad36902d1e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.373849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.374469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.374742 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.375010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.375626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.377564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.391081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-256fc5db-7803-40fd-8848-73eba2d8de2f None None] MFA Rules not processed for user `8921841b7820412ca2691c0db6711f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:46.392304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-256fc5db-7803-40fd-8848-73eba2d8de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:46.400000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 786/1588] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:46.403182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.413553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7f26e-7646-4fec-8101-009978da5098 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.418075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.418679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.418951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.419218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.419830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.421746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.442472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:46.443225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 787/1589] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:46.444009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.469559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 803/1590] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:46.471103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531864c5-f242-467e-98a6-f9e3a000e292 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.471384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531864c5-f242-467e-98a6-f9e3a000e292 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.471790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531864c5-f242-467e-98a6-f9e3a000e292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.491168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-531864c5-f242-467e-98a6-f9e3a000e292 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:46.492739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-531864c5-f242-467e-98a6-f9e3a000e292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:46.500608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 804/1591] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:46.501534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531864c5-f242-467e-98a6-f9e3a000e292 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.515209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bda93-b33d-4c9e-b55b-3a09b6e78514 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.518907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531864c5-f242-467e-98a6-f9e3a000e292 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.520694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.521375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.521726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.522069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.524016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.524644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.524907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.525181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.525824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.527485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.531919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.534162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.537795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 805/1592] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.538704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.546809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 788/1593] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:46.547609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.548382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a16c4e-e6cd-45c5-9657-4c2333106373 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.553015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.553808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.553952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.554257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.554888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.556503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.557927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880aeb2-f4d5-4d2d-afc9-3eb160c26c76 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.563624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.564219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.564493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.564769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.566409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.571035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 806/1594] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.571236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.571339 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.574416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:46.580147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 789/1595] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.581892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.585481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072542c0-59da-4891-9c7f-c6f76e61b1f9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.590479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba463c-d8dd-4db8-8c14-3658f133be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.591160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba463c-d8dd-4db8-8c14-3658f133be7a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.591520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba463c-d8dd-4db8-8c14-3658f133be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.591870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba463c-d8dd-4db8-8c14-3658f133be7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.592518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba463c-d8dd-4db8-8c14-3658f133be7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.594135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba463c-d8dd-4db8-8c14-3658f133be7a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.594498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d95e4b-ac2c-4fff-bfa6-1188c40bd6c4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.599205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.599807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.600114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.600389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.601015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.602647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.605344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 807/1596] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.606631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e7b0-8205-4f30-bb57-ea842ee75c25 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.606918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e7b0-8205-4f30-bb57-ea842ee75c25 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.607375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e7b0-8205-4f30-bb57-ea842ee75c25 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.608875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 808/1597] 10.222.0.52 () {54 vars in 962 bytes} [Fri Sep 9 14:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:57:46.609495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e7b0-8205-4f30-bb57-ea842ee75c25 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.611300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c0b0e7b0-8205-4f30-bb57-ea842ee75c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:46.618599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 790/1598] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.619749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.626793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e7b0-8205-4f30-bb57-ea842ee75c25 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.631774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.632385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.632793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.633075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.635244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ac4c1-d021-465a-b5ac-fa2cc695c757 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.640808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.641488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.641835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.642253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.643789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.644100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.645540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.646197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.658261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 809/1599] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:46.660490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.662412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 791/1600] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.663490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.673262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e1537-f3d6-483a-8761-0a33fea1a33b service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.676777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e409cf8-0b16-41cc-aaa4-744f5eb5e409 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.680961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.686266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.686266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.686266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.686266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.687089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.690481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b9c3e-c326-47f5-a0ed-9560e5e3fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.691420 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9c3e-c326-47f5-a0ed-9560e5e3fa3d admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.691862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9c3e-c326-47f5-a0ed-9560e5e3fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.692482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b9c3e-c326-47f5-a0ed-9560e5e3fa3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.693318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b9c3e-c326-47f5-a0ed-9560e5e3fa3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.699803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b9c3e-c326-47f5-a0ed-9560e5e3fa3d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.703031 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 810/1601] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.704567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.717988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604d38e-1565-4f4c-ac09-6af66d1982d4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.728748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.729464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.729819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.730311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.731041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.731796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 792/1602] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.733798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b193-fd79-4cbc-a272-fcf07612d163 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.734100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b193-fd79-4cbc-a272-fcf07612d163 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.734393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b193-fd79-4cbc-a272-fcf07612d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.746528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.766896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 811/1603] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.766896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.784474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9483-d2f3-40b3-a04c-c8a331e030ca admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.791745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.792599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.793234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.793511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.794446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.797834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.803395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a319b193-fd79-4cbc-a272-fcf07612d163 None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:46.804679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a319b193-fd79-4cbc-a272-fcf07612d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:46.814294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 812/1604] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:46.816118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.829603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75201cf0-49e3-4be4-9309-fd32b29075f1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:46.838919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:46.839899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:46.840182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:46.840586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] PATH_INFO: `/v3/projects/df4e72fc010440a8ad8af109d8285f34/users/4bcd5d323ed6428d92b299218e900d2b/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:46.862445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4e72fc010440a8ad8af109d8285f34, user_id=4bcd5d323ed6428d92b299218e900d2b, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:46.868237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:46.892882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 813/1605] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:46 2022] PUT /identity/v3/projects/df4e72fc010440a8ad8af109d8285f34/users/4bcd5d323ed6428d92b299218e900d2b/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:46.894069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.917014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 793/1606] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Sep 9 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:46.929041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319b193-fd79-4cbc-a272-fcf07612d163 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:46.952604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319b193-fd79-4cbc-a272-fcf07612d163 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.042722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90a229-2890-454c-a8ac-eef272e6ecf4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.055064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.056143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.056583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.057345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] PATH_INFO: `/v3/projects/0f86f6c43fd348129b71a8e10aaa77d4/users/02804ff8233b43fdbc62c1380457e48a/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.059016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.059698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.059985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.060254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] PATH_INFO: `/v3/projects/0a516458980c4e7eba3c8e4eaa0e21f8/users/23dccda2753a4956a7f0c936682ce100/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.082968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f86f6c43fd348129b71a8e10aaa77d4, user_id=02804ff8233b43fdbc62c1380457e48a, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.085653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.119024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a516458980c4e7eba3c8e4eaa0e21f8, user_id=23dccda2753a4956a7f0c936682ce100, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.122432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.130200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 794/1607] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:46 2022] PUT /identity/v3/projects/0f86f6c43fd348129b71a8e10aaa77d4/users/02804ff8233b43fdbc62c1380457e48a/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:47.132753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:47.155979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 814/1608] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:46 2022] PUT /identity/v3/projects/0a516458980c4e7eba3c8e4eaa0e21f8/users/23dccda2753a4956a7f0c936682ce100/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:47.157241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:47.194806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:47.196450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:47.250780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6637b-c64c-41c8-8091-f20d717e47dc admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.257323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bc386-766e-4892-ad4f-17217e6cbc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.257908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc386-766e-4892-ad4f-17217e6cbc0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.258224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc386-766e-4892-ad4f-17217e6cbc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.258502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bc386-766e-4892-ad4f-17217e6cbc0e admin admin] PATH_INFO: `/v3/projects/c7ea716f663e4f74a555107bf6efbcbb/users/a1e83d427658438e9fce9b09333b2b50/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.258625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1021f42-1503-47b5-9e66-815739918d34 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.264775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.265638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.266045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.266442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] PATH_INFO: `/v3/projects/1ac504b0864c408fb4c635b3dd5aed83/users/2b2e394413974cd282048e582447aeb7/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.276468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bc386-766e-4892-ad4f-17217e6cbc0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ea716f663e4f74a555107bf6efbcbb, user_id=a1e83d427658438e9fce9b09333b2b50, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.279705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bc386-766e-4892-ad4f-17217e6cbc0e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.283450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac504b0864c408fb4c635b3dd5aed83, user_id=2b2e394413974cd282048e582447aeb7, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.287316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.309485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 795/1609] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:47 2022] PUT /identity/v3/projects/c7ea716f663e4f74a555107bf6efbcbb/users/a1e83d427658438e9fce9b09333b2b50/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:47.309485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cfdf4-0c97-4174-9d8a-963c4d359a3b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.309485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cfdf4-0c97-4174-9d8a-963c4d359a3b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.309485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cfdf4-0c97-4174-9d8a-963c4d359a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.318134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 815/1610] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:47 2022] PUT /identity/v3/projects/1ac504b0864c408fb4c635b3dd5aed83/users/2b2e394413974cd282048e582447aeb7/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:47.322389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:47.326533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-692cfdf4-0c97-4174-9d8a-963c4d359a3b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:47.327920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-692cfdf4-0c97-4174-9d8a-963c4d359a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:47.403809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 796/1611] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:47.404267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34276a06-677f-4017-b769-60ff2bc2f54e None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.404676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34276a06-677f-4017-b769-60ff2bc2f54e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.405014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34276a06-677f-4017-b769-60ff2bc2f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.420037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb5bc2-8fa1-49a0-bc8e-d18f2edacd71 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.426737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e05b-7980-4a8d-ac05-4b7d5a09c3a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.427688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e05b-7980-4a8d-ac05-4b7d5a09c3a5 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.427968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e05b-7980-4a8d-ac05-4b7d5a09c3a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.428881 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e05b-7980-4a8d-ac05-4b7d5a09c3a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.442338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-34276a06-677f-4017-b769-60ff2bc2f54e None None] MFA Rules not processed for user `02804ff8233b43fdbc62c1380457e48a`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:47.444033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-34276a06-677f-4017-b769-60ff2bc2f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:47.508968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e05b-7980-4a8d-ac05-4b7d5a09c3a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.510979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e05b-7980-4a8d-ac05-4b7d5a09c3a5 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.521934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 816/1612] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:47.523558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ba47-517e-4c9d-bde0-b62dc03dc41c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.523916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ba47-517e-4c9d-bde0-b62dc03dc41c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.524307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2ba47-517e-4c9d-bde0-b62dc03dc41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.531802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 797/1613] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:47.533462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91f29e-d1bc-43c8-b07d-d8a612362def None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.534298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91f29e-d1bc-43c8-b07d-d8a612362def None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.535218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91f29e-d1bc-43c8-b07d-d8a612362def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.547562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3cd2ba47-517e-4c9d-bde0-b62dc03dc41c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:47.548859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3cd2ba47-517e-4c9d-bde0-b62dc03dc41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:47.558458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 817/1614] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:47.561755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a7e96-c000-426b-94d2-41fcfec0fcf3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.561755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a7e96-c000-426b-94d2-41fcfec0fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.561755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a7e96-c000-426b-94d2-41fcfec0fcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.598203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a60a7e96-c000-426b-94d2-41fcfec0fcf3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:47.602443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-4d91f29e-d1bc-43c8-b07d-d8a612362def None None] MFA Rules not processed for user `a1e83d427658438e9fce9b09333b2b50`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:47.604535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4d91f29e-d1bc-43c8-b07d-d8a612362def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:47.612287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a60a7e96-c000-426b-94d2-41fcfec0fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:47.637270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 818/1615] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:47.639536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a7e96-c000-426b-94d2-41fcfec0fcf3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:47.670147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:47.717314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:47.756404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a7e96-c000-426b-94d2-41fcfec0fcf3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.761436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7c342-9796-4c6a-a397-6ee1c0aef02d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.762060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7c342-9796-4c6a-a397-6ee1c0aef02d service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.763080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7c342-9796-4c6a-a397-6ee1c0aef02d service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.763714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7c342-9796-4c6a-a397-6ee1c0aef02d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.774160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 798/1616] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:47.776534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91f29e-d1bc-43c8-b07d-d8a612362def None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:47.787150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7c342-9796-4c6a-a397-6ee1c0aef02d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.788737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7c342-9796-4c6a-a397-6ee1c0aef02d service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.806662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 819/1617] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:47.806662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b1474-e8c8-4bc9-b9dd-c80905c544b3 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.806662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b1474-e8c8-4bc9-b9dd-c80905c544b3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.806662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b1474-e8c8-4bc9-b9dd-c80905c544b3 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.807389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91f29e-d1bc-43c8-b07d-d8a612362def None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.811222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 820/1618] 10.222.0.52 () {54 vars in 962 bytes} [Fri Sep 9 14:57:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:57:47.812602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b1474-e8c8-4bc9-b9dd-c80905c544b3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:47.818163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.819155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.819592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.820736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.828747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b1474-e8c8-4bc9-b9dd-c80905c544b3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:47.841712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b66631-a649-4627-a34c-9678e58f1899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:47.842733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66631-a649-4627-a34c-9678e58f1899 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.843267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66631-a649-4627-a34c-9678e58f1899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.844142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b66631-a649-4627-a34c-9678e58f1899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.845783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.849768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.869385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b66631-a649-4627-a34c-9678e58f1899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:47.873773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b66631-a649-4627-a34c-9678e58f1899 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:47.879917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 799/1619] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:47.880946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:47.915180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 821/1620] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:47.915180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805832c-cd7d-495a-bc83-8d9cec383b34 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.915180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805832c-cd7d-495a-bc83-8d9cec383b34 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.915180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805832c-cd7d-495a-bc83-8d9cec383b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:47.968182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9805832c-cd7d-495a-bc83-8d9cec383b34 None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:47.970979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9805832c-cd7d-495a-bc83-8d9cec383b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:47.993569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 822/1621] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Sep 9 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:47.995346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4034b-919c-4847-ac53-3374edb49015 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:47.995860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4034b-919c-4847-ac53-3374edb49015 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:47.996708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4034b-919c-4847-ac53-3374edb49015 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.003456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 823/1622] 10.222.0.52 () {54 vars in 912 bytes} [Fri Sep 9 14:57:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:57:48.005157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0ba03-4690-4a54-be1b-67d7892e46eb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.005288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0ba03-4690-4a54-be1b-67d7892e46eb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.005508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0ba03-4690-4a54-be1b-67d7892e46eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.032927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-14e0ba03-4690-4a54-be1b-67d7892e46eb None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:48.034187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5d778-6a0d-48a2-8418-4f579b7dfa95 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:48.035461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-14e0ba03-4690-4a54-be1b-67d7892e46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:48.039095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:48.040040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.040424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.040795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.052823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:48.054387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:48.058219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 824/1623] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:48.077963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0ba03-4690-4a54-be1b-67d7892e46eb None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:48.080791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 800/1624] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:48.083835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:48.093185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0ba03-4690-4a54-be1b-67d7892e46eb None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:48.103440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:48.103991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.104310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.104583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.108136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa1f82-a5af-44be-bccc-7a2428de38cc service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:48.118076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:48.119724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2af38-27fa-4ebe-8c55-70f9aa477f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:48.121148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2af38-27fa-4ebe-8c55-70f9aa477f94 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.121531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:48.121995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2af38-27fa-4ebe-8c55-70f9aa477f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.125049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2af38-27fa-4ebe-8c55-70f9aa477f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.146689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 825/1625] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:48.150584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2af38-27fa-4ebe-8c55-70f9aa477f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:48.153865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2af38-27fa-4ebe-8c55-70f9aa477f94 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:48.187230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 801/1626] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:48.501621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:48.516347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643dc93-4388-4158-a22f-ba5c936fe799 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:48.529562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:48.531774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.532061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.532332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] PATH_INFO: `/v3/users/8921841b7820412ca2691c0db6711f9f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.537103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8921841b7820412ca2691c0db6711f9f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:48.539172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: WARNING py.warnings [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:57:48.539172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: warnings.warn(msg) Sep 09 14:57:48.539172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: Sep 09 14:57:48.542255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:48.712939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8921841b7820412ca2691c0db6711f9f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:48.733415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8921841b7820412ca2691c0db6711f9f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:48.790769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8921841b7820412ca2691c0db6711f9f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:48.791719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8921841b7820412ca2691c0db6711f9f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:48.824057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-bb752d8d-8b53-4a6f-ace2-844a4d6a806f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8921841b7820412ca2691c0db6711f9f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:48.835317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577595f-9208-4fdc-9378-626c2be238f6 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.835882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577595f-9208-4fdc-9378-626c2be238f6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.835882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577595f-9208-4fdc-9378-626c2be238f6 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.837680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 802/1627] 10.222.0.52 () {54 vars in 912 bytes} [Fri Sep 9 14:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:57:48.846664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 826/1628] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:57:48 2022] DELETE /identity/v3/users/8921841b7820412ca2691c0db6711f9f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:48.848915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.849770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.849770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.861536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:48.862457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:48.862741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:48.890295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:48.894351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:48.906857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:48.909977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:49.032701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 803/1629] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:49.060858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:49.103396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 827/1630] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:57:49.119202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:49.122930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:49.235847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:49.246669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d24a9b-03c2-43fc-8bc7-2ee39f09acad None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:49.251342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:49.252119 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:49.253161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:49.253597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:49.268652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:49.270616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:49.298410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 804/1631] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:49.312664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:49.315737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:49.441558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c5a2f-8c4b-4a76-a3e6-117c3a2e35b6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:49.458375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be307-0dce-4fc9-a1d8-786e14cf724d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:49.458375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be307-0dce-4fc9-a1d8-786e14cf724d service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:49.458375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be307-0dce-4fc9-a1d8-786e14cf724d service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:49.459229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be307-0dce-4fc9-a1d8-786e14cf724d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:49.478135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be307-0dce-4fc9-a1d8-786e14cf724d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:49.479619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be307-0dce-4fc9-a1d8-786e14cf724d service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:49.495678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 828/1632] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:51.559901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:51.562209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:51.606865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccea31-c7ba-4c6d-8920-f11b1d45c997 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:51.618017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:51.618826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:51.619161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:51.619861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] PATH_INFO: `/v3/projects/b6cede85471c4bb4a029660cebc02f4f` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:51.625549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cede85471c4bb4a029660cebc02f4f)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:51.628191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: WARNING py.warnings [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 14:57:51.628191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: warnings.warn(msg) Sep 09 14:57:51.628191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: Sep 09 14:57:51.632842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:51.782163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cede85471c4bb4a029660cebc02f4f', 'request_id': 'req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:51.807841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cede85471c4bb4a029660cebc02f4f', 'request_id': 'req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:51.825164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cede85471c4bb4a029660cebc02f4f', 'request_id': 'req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:51.839977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] The token cache is being invalidate because project b6cede85471c4bb4a029660cebc02f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:57:51.840562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:51.841385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f2fdbb72-b5e3-4cf9-a394-9e9b52a68a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:51.843519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 805/1633] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:57:51 2022] DELETE /identity/v3/projects/b6cede85471c4bb4a029660cebc02f4f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:51.848763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aad808-de63-464c-9766-3e5649922305 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:51.849308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aad808-de63-464c-9766-3e5649922305 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:51.849308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aad808-de63-464c-9766-3e5649922305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:51.881175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c8aad808-de63-464c-9766-3e5649922305 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:51.883439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c8aad808-de63-464c-9766-3e5649922305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:52.104334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 829/1634] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:52.113338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f64d77-20b1-4c2a-97cc-c54289f27b8c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:52.113789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f64d77-20b1-4c2a-97cc-c54289f27b8c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:52.114064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f64d77-20b1-4c2a-97cc-c54289f27b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:52.171336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-20f64d77-20b1-4c2a-97cc-c54289f27b8c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:52.172691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-20f64d77-20b1-4c2a-97cc-c54289f27b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:52.212503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aad808-de63-464c-9766-3e5649922305 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:52.220045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 806/1635] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:52.231476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aad808-de63-464c-9766-3e5649922305 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:52.240821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:52.245463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:52.246187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:52.246420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:52.249488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:57:52.249804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:52.268255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:52.347682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f64d77-20b1-4c2a-97cc-c54289f27b8c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:52.358426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f64d77-20b1-4c2a-97cc-c54289f27b8c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:52.359564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 830/1636] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:57:52.385231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:52.391771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:52.392077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:52.392342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:52.400366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:52.416340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:52.508639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 807/1637] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:52 2022] POST /identity/v3/projects => generated 405 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:57:52.513827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:52.530392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803af2af-a429-459b-8944-d1d8cbb24fc1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:52.674183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:52.674960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:52.675276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:52.675567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:52.676440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:52.678394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:52.744856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 831/1638] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:52 2022] POST /identity/v3/users => generated 303 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:52.746352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:52.764429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c571561-82a8-4194-9cdf-9b4c8fff4e42 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:52.801035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:52.801685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:52.801967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:52.804132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:52.806573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:52.812399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:52.844450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 808/1639] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:52.846029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:52.860633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc14ca2-e9e8-44ca-adf1-0d065a766783 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:52.884803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db60e54-5497-4263-b45c-bbef95950d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:52.885443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db60e54-5497-4263-b45c-bbef95950d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:52.885727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db60e54-5497-4263-b45c-bbef95950d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:52.886003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db60e54-5497-4263-b45c-bbef95950d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:52.894763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db60e54-5497-4263-b45c-bbef95950d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:52.898571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db60e54-5497-4263-b45c-bbef95950d9d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:52.934130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 832/1640] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:52.935395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:52.954977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa22721-8546-4263-a647-96a2ea74c5f7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:52.969701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:52.970461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:52.970750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:52.971068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] PATH_INFO: `/v3/projects/1eb87edf2ce44afd8633c7fdb5d24c5c/users/14ab59317d924c2891e1618df956d189/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.015923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb87edf2ce44afd8633c7fdb5d24c5c, user_id=14ab59317d924c2891e1618df956d189, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:53.021107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:53.060876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 809/1641] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:52 2022] PUT /identity/v3/projects/1eb87edf2ce44afd8633c7fdb5d24c5c/users/14ab59317d924c2891e1618df956d189/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:53.063421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf8f28-8bcd-4422-b2e3-b8bb98d5131a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.063714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf8f28-8bcd-4422-b2e3-b8bb98d5131a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.063996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf8f28-8bcd-4422-b2e3-b8bb98d5131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.079546 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:53.137039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-51bf8f28-8bcd-4422-b2e3-b8bb98d5131a None None] MFA Rules not processed for user `14ab59317d924c2891e1618df956d189`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:53.142523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-51bf8f28-8bcd-4422-b2e3-b8bb98d5131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:53.320982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 833/1642] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:53.325294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:53.464526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bac1b-8df1-4d8d-98a3-8760eee4c972 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:53.485992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:53.486854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.487235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.487517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.488174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:53.490138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:53.513400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:53.535213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 810/1643] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:57:53 2022] POST /identity/v3/projects => generated 405 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:53.539018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf8f28-8bcd-4422-b2e3-b8bb98d5131a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:53.560733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf8f28-8bcd-4422-b2e3-b8bb98d5131a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:53.672971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:53.673660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.674680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.674958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.675677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:53.677764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:53.716475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 834/1644] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:57:53 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:57:53.720209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:53.734313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b683b3-189f-4cea-b36a-905472fd085f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:53.746249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:53.747399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.748323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.748762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.749794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:53.752108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:53.765035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 811/1645] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:53.769201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:53.779313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f235f-4837-421b-8d87-ceb5986e8759 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:53.784973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:53.785701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.785982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.786347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] PATH_INFO: `/v3/projects/db2d4c3830ee477489388d5ea285947c/users/b1f15141f50743e0858e1ac7bb994bdc/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.811149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2d4c3830ee477489388d5ea285947c, user_id=b1f15141f50743e0858e1ac7bb994bdc, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:53.815166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:53.833593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 835/1646] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:53 2022] PUT /identity/v3/projects/db2d4c3830ee477489388d5ea285947c/users/b1f15141f50743e0858e1ac7bb994bdc/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:57:53.837663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:53.849274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183d117-b9ba-4e22-ab3a-ac495e522bcf admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:53.913570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1869c-72a0-4b1c-8159-956ff20eb86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:53.914923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1869c-72a0-4b1c-8159-956ff20eb86f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.915208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1869c-72a0-4b1c-8159-956ff20eb86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.915481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1869c-72a0-4b1c-8159-956ff20eb86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.916508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1869c-72a0-4b1c-8159-956ff20eb86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:53.918543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1869c-72a0-4b1c-8159-956ff20eb86f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:53.938629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 812/1647] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:57:53.940691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:53.954146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985346e-cbcc-44b1-b0bb-0106b13ce825 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:53.960929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:53.962587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.963079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.963352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] PATH_INFO: `/v3/projects/db2d4c3830ee477489388d5ea285947c/users/b1f15141f50743e0858e1ac7bb994bdc/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.965469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2d4c3830ee477489388d5ea285947c, user_id=b1f15141f50743e0858e1ac7bb994bdc, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:53.968545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:53.995107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24024a4a-029f-4521-8060-2d5c8c79914c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:53.995486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24024a4a-029f-4521-8060-2d5c8c79914c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:53.995814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24024a4a-029f-4521-8060-2d5c8c79914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:53.999838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 836/1648] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:57:53 2022] PUT /identity/v3/projects/db2d4c3830ee477489388d5ea285947c/users/b1f15141f50743e0858e1ac7bb994bdc/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:57:54.041258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-24024a4a-029f-4521-8060-2d5c8c79914c None None] MFA Rules not processed for user `b1f15141f50743e0858e1ac7bb994bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:54.043977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-24024a4a-029f-4521-8060-2d5c8c79914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:54.139234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 813/1649] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:54.151462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:54.154465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:54.318602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:54.335762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a6ce8-f5ca-46d3-908e-70b084a5a6a3 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:54.344517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d652b-7bca-4868-af1a-93aaa4f73dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:54.345300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d652b-7bca-4868-af1a-93aaa4f73dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:54.345934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d652b-7bca-4868-af1a-93aaa4f73dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:54.346467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d652b-7bca-4868-af1a-93aaa4f73dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:54.389808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d652b-7bca-4868-af1a-93aaa4f73dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:54.391348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d652b-7bca-4868-af1a-93aaa4f73dc5 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:54.423390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 837/1650] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:54 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:54.735495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24024a4a-029f-4521-8060-2d5c8c79914c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:54.917414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24024a4a-029f-4521-8060-2d5c8c79914c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:54.931939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:54.934511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:54.934796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:54.935146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] PATH_INFO: `/v3/users/14ab59317d924c2891e1618df956d189` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:54.939075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ab59317d924c2891e1618df956d189)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:54.945545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:54.961577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:55.104339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ab59317d924c2891e1618df956d189'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:55.122208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ab59317d924c2891e1618df956d189'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:55.123161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ab59317d924c2891e1618df956d189'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:55.149080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ab59317d924c2891e1618df956d189'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:55.180745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ab59317d924c2891e1618df956d189'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:55.198981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 814/1651] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:57:54 2022] DELETE /identity/v3/users/14ab59317d924c2891e1618df956d189 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:55.203900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:55.204903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:55.205698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:55.238488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:55.250538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:55.400273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 838/1652] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:57:55.429513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:55.431820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:55.600653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2d2e-efeb-474e-b939-44224398beff admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:55.621173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ac23b-e524-40d4-8e8a-646b4c57cc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:55.621967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ac23b-e524-40d4-8e8a-646b4c57cc3e service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:55.622279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ac23b-e524-40d4-8e8a-646b4c57cc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:55.622552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ac23b-e524-40d4-8e8a-646b4c57cc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:55.638892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ac23b-e524-40d4-8e8a-646b4c57cc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:55.640341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ac23b-e524-40d4-8e8a-646b4c57cc3e service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:55.669661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 815/1653] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:56.492880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:56.496464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:56.522079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd92a5-740b-475e-bf08-3c54c1f04846 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:56.538811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:56.539475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:56.539753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:56.542714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] PATH_INFO: `/v3/users/02804ff8233b43fdbc62c1380457e48a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:56.548343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] RBAC: Authorizing `identity:delete_user(user_id=02804ff8233b43fdbc62c1380457e48a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:56.552241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:56.685220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02804ff8233b43fdbc62c1380457e48a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:56.707473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02804ff8233b43fdbc62c1380457e48a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:56.739053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02804ff8233b43fdbc62c1380457e48a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:56.739819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02804ff8233b43fdbc62c1380457e48a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:56.761495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02804ff8233b43fdbc62c1380457e48a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:56.788277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 839/1654] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:57:56 2022] DELETE /identity/v3/users/02804ff8233b43fdbc62c1380457e48a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:56.789957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9a94-2d81-48b8-87e7-aeabe1a13d19 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:56.791954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9a94-2d81-48b8-87e7-aeabe1a13d19 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:56.792244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc9a94-2d81-48b8-87e7-aeabe1a13d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:56.850298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fbdc9a94-2d81-48b8-87e7-aeabe1a13d19 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:56.851628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fbdc9a94-2d81-48b8-87e7-aeabe1a13d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:57.024285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 816/1655] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:57.069292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:57.071171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:57.241568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7609f2-6721-4afa-8c31-f9216968820f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:57.246423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:57.247240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:57.247625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:57.248010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:57.270290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:57.273807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:57.299599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 840/1656] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:57.629284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:57.629284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:57.629284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:57.718871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] MFA Rules not processed for user `b12eee6f7bee44c6a2cb31de030e0e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:57:57.722681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:57.756130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:57.879024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:57.880462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:57.886526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 817/1657] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:57:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:57:57.888324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:57:58.141537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734e388-1225-475a-8028-ad25ced70644 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:58.161586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:58.162252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:58.162536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:58.162808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:58.186347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:58.189767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:58.214650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 841/1658] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:57:58.645335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:58.649502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:57:58.696843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8adf4-ff69-4ec6-aa92-f602bd076ef9 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:58.733393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:58.733934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:58.734246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:58.734514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] PATH_INFO: `/v3/projects/1eb87edf2ce44afd8633c7fdb5d24c5c` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:58.744192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb87edf2ce44afd8633c7fdb5d24c5c)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:58.746512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:58.892427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb87edf2ce44afd8633c7fdb5d24c5c', 'request_id': 'req-571310c5-0cb5-4c17-a32e-01dff50a48de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:58.925109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb87edf2ce44afd8633c7fdb5d24c5c', 'request_id': 'req-571310c5-0cb5-4c17-a32e-01dff50a48de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:58.941275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb87edf2ce44afd8633c7fdb5d24c5c', 'request_id': 'req-571310c5-0cb5-4c17-a32e-01dff50a48de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:58.993430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] The token cache is being invalidate because project 1eb87edf2ce44afd8633c7fdb5d24c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:57:58.994200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:58.996166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:59.003074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 818/1659] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:57:58 2022] DELETE /identity/v3/projects/1eb87edf2ce44afd8633c7fdb5d24c5c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:57:59.007128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:57:59.043179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c00af-89df-4b03-b8cd-2b37074f6772 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:57:59.203230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:57:59.203897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:57:59.204175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:57:59.204444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] PATH_INFO: `/v3/users/b1f15141f50743e0858e1ac7bb994bdc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:57:59.206731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f15141f50743e0858e1ac7bb994bdc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:57:59.208939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:57:59.344317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f15141f50743e0858e1ac7bb994bdc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:59.367241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f15141f50743e0858e1ac7bb994bdc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:59.412919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f15141f50743e0858e1ac7bb994bdc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:59.413835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f15141f50743e0858e1ac7bb994bdc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:59.429125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f15141f50743e0858e1ac7bb994bdc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:57:59.448748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 842/1660] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:57:59 2022] DELETE /identity/v3/users/b1f15141f50743e0858e1ac7bb994bdc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:00.029870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:00.032118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:00.055927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571310c5-0cb5-4c17-a32e-01dff50a48de admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:00.228344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:00.230202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:00.230480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:00.230750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] PATH_INFO: `/v3/users/a1e83d427658438e9fce9b09333b2b50` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:00.232549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e83d427658438e9fce9b09333b2b50)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:00.234520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:00.295743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:00.297238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:00.323389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cadbc-ea5e-4748-9bda-c7cdd81299ac admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:00.338812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:00.341457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:00.342553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:00.342844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] PATH_INFO: `/v3/projects/0f86f6c43fd348129b71a8e10aaa77d4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:00.347462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f86f6c43fd348129b71a8e10aaa77d4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:00.353979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:00.358851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:00.359211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:00.363482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e83d427658438e9fce9b09333b2b50'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.383804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e83d427658438e9fce9b09333b2b50'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.384638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e83d427658438e9fce9b09333b2b50'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.404036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e83d427658438e9fce9b09333b2b50'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.435785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6022561a-71eb-4125-8b8f-e61e6c8797f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e83d427658438e9fce9b09333b2b50'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.447824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 819/1661] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:00 2022] DELETE /identity/v3/users/a1e83d427658438e9fce9b09333b2b50 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:00.452326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc513-a3cb-429b-9ca3-0bbf9aeebf14 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:00.452615 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc513-a3cb-429b-9ca3-0bbf9aeebf14 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:00.452897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc513-a3cb-429b-9ca3-0bbf9aeebf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:00.505151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a18bc513-a3cb-429b-9ca3-0bbf9aeebf14 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:00.508097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f86f6c43fd348129b71a8e10aaa77d4', 'request_id': 'req-6b2e4b9c-423c-4873-b83a-951770fe6743'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.523607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a18bc513-a3cb-429b-9ca3-0bbf9aeebf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:00.525973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f86f6c43fd348129b71a8e10aaa77d4', 'request_id': 'req-6b2e4b9c-423c-4873-b83a-951770fe6743'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.542460 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f86f6c43fd348129b71a8e10aaa77d4', 'request_id': 'req-6b2e4b9c-423c-4873-b83a-951770fe6743'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.569069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] The token cache is being invalidate because project 0f86f6c43fd348129b71a8e10aaa77d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:00.569724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.573138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-6b2e4b9c-423c-4873-b83a-951770fe6743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:00.580669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 843/1662] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:00 2022] DELETE /identity/v3/projects/0f86f6c43fd348129b71a8e10aaa77d4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:00.582941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3157f-7655-4703-8639-c382f3edcc30 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:00.582941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3157f-7655-4703-8639-c382f3edcc30 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:00.590489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3157f-7655-4703-8639-c382f3edcc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:00.637897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-40e3157f-7655-4703-8639-c382f3edcc30 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:00.645836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-40e3157f-7655-4703-8639-c382f3edcc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:00.719809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 820/1663] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:00.819619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 844/1664] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:00.827638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:00.827924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:00.828191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:00.870962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:00.874308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:00.896777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 821/1665] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:00.900990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3157f-7655-4703-8639-c382f3edcc30 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:00.909363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:00.912441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:00.921676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3157f-7655-4703-8639-c382f3edcc30 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:00.939172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:00.940789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:00.941083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:00.941343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:00.941996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:00.944763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:00.948893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:00.979265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 845/1666] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:00.983825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:01.008868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0610ef-874d-49aa-afd9-d217e68072b9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:01.030281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:01.030892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:01.031173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:01.031446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:01.036639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:01.042455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:01.086687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500548a-fb93-4cde-9cf3-eaa87d2b48ab None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:01.098696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:01.099621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:01.100049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:01.100487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:01.133920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:01.135344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:01.144999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 846/1667] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:00 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:01.149965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:01.181650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 822/1668] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:01.319937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:01.330337 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f4439-04a3-4d84-b35e-f3c01a413796 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:01.340483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:01.340757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:01.341178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:01.341455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:01.342113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:01.344075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:01.393592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 847/1669] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:01 2022] POST /identity/v3/users => generated 282 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:01.397531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:01.415553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3c4a-22a3-4017-8ae4-429d5999cff4 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:01.430030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:01.432330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:01.433586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:01.434071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:01.439852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:01.441692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:01.469724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 823/1670] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:01.474559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:01.492119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c151c-d076-43f9-8775-8d23350f5151 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:01.505481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0af1d5-f462-4bf9-9cd8-054ef07abd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:01.505795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af1d5-f462-4bf9-9cd8-054ef07abd7b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:01.506447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af1d5-f462-4bf9-9cd8-054ef07abd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:01.506800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af1d5-f462-4bf9-9cd8-054ef07abd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:01.507524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0af1d5-f462-4bf9-9cd8-054ef07abd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:01.509405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0af1d5-f462-4bf9-9cd8-054ef07abd7b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:01.547212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:01.562069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 848/1671] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:01.569943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c086a8-70da-4be7-9cba-7aaa2129e9b2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:01.592384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:01.593085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:01.593366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:01.593683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] PATH_INFO: `/v3/projects/22703cdad80748e0b48d6ce3a2819ff5/users/f7dcf475d2524d30a8c710d1e00782df/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:01.624626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22703cdad80748e0b48d6ce3a2819ff5, user_id=f7dcf475d2524d30a8c710d1e00782df, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:01.629061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:01.667586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 824/1672] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:01 2022] PUT /identity/v3/projects/22703cdad80748e0b48d6ce3a2819ff5/users/f7dcf475d2524d30a8c710d1e00782df/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:01.684292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7c1d-f66e-4b0c-8dc6-d47b6b18b717 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:01.684584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7c1d-f66e-4b0c-8dc6-d47b6b18b717 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:01.684864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f7c1d-f66e-4b0c-8dc6-d47b6b18b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:01.759033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f54f7c1d-f66e-4b0c-8dc6-d47b6b18b717 None None] MFA Rules not processed for user `f7dcf475d2524d30a8c710d1e00782df`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:01.760783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f54f7c1d-f66e-4b0c-8dc6-d47b6b18b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:01.954598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 849/1673] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:01.956758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:02.014565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:02.093878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2db87d-6d30-4331-9a08-8131499d05d6 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:02.102533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:02.103987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.104274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.104548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.105206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:02.107276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:02.164414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 825/1674] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:01 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:02.168979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7c1d-f66e-4b0c-8dc6-d47b6b18b717 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:02.186941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f7c1d-f66e-4b0c-8dc6-d47b6b18b717 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:02.274852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:02.275482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.275767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.276048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.276688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:02.278692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:02.308796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 850/1675] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:02 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:02.313818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:02.326178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031736-9bea-4485-8678-0bae397c8766 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:02.340069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:02.340362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.342629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.350225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.351674 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:02.354374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:02.381542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:02.393376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 826/1676] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:02.398113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbc830-1950-4f9d-af06-c9c38f7f2c05 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:02.404474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:02.405480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.405963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.407086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] PATH_INFO: `/v3/projects/5bd78779a70b475ab8e0112b10a00fc4/users/7e74897e7d98450a8160ebe848544ec3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.430143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd78779a70b475ab8e0112b10a00fc4, user_id=7e74897e7d98450a8160ebe848544ec3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:02.434220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:02.458714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 851/1677] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:02 2022] PUT /identity/v3/projects/5bd78779a70b475ab8e0112b10a00fc4/users/7e74897e7d98450a8160ebe848544ec3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:02.459893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:02.500066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b49efc-caf4-4e12-9150-95e28497322c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:02.605985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1c79b-e71d-4e87-9e1d-b43ad53fc304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:02.607081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1c79b-e71d-4e87-9e1d-b43ad53fc304 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.608389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1c79b-e71d-4e87-9e1d-b43ad53fc304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.608874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1c79b-e71d-4e87-9e1d-b43ad53fc304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.611507 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1c79b-e71d-4e87-9e1d-b43ad53fc304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:02.614940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1c79b-e71d-4e87-9e1d-b43ad53fc304 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:02.639273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 827/1678] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:02.639479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:02.657052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc1cb3-9648-454c-9f9d-73b10ed756df admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:02.673703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cbb59-d44b-4be8-af6d-b7110cebf81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:02.673959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbb59-d44b-4be8-af6d-b7110cebf81f admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.674292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbb59-d44b-4be8-af6d-b7110cebf81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.675311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbb59-d44b-4be8-af6d-b7110cebf81f admin admin] PATH_INFO: `/v3/projects/5bd78779a70b475ab8e0112b10a00fc4/users/7e74897e7d98450a8160ebe848544ec3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.677934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cbb59-d44b-4be8-af6d-b7110cebf81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd78779a70b475ab8e0112b10a00fc4, user_id=7e74897e7d98450a8160ebe848544ec3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:02.689683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cbb59-d44b-4be8-af6d-b7110cebf81f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:02.714206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 852/1679] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:02 2022] PUT /identity/v3/projects/5bd78779a70b475ab8e0112b10a00fc4/users/7e74897e7d98450a8160ebe848544ec3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:02.726184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.726479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.726819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.781710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] MFA Rules not processed for user `7e74897e7d98450a8160ebe848544ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:02.783161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:02.891329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:02.891737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:02.892108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:02.932914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 828/1680] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:02.947745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:02.949525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:02.968891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] MFA Rules not processed for user `507a05e50d1345d498bb0f06fe4ef2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:02.973134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:02.979011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:03.009825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:03.127883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbb811-7905-467e-905b-e77278896c98 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:03.139561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d3cac-e1b5-46c6-9274-31a949f91abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:03.140277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3cac-e1b5-46c6-9274-31a949f91abf service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:03.140990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3cac-e1b5-46c6-9274-31a949f91abf service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:03.140990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3cac-e1b5-46c6-9274-31a949f91abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:03.171963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d3cac-e1b5-46c6-9274-31a949f91abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:03.176837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d3cac-e1b5-46c6-9274-31a949f91abf service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:03.213126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 853/1681] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:03.223104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 829/1682] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:03.225780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:03.231584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9c484-d49f-49cf-b3cb-03ee66e3e1ee None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:03.231584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9c484-d49f-49cf-b3cb-03ee66e3e1ee None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:03.231584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9c484-d49f-49cf-b3cb-03ee66e3e1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:03.232571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:03.315598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b7a9c484-d49f-49cf-b3cb-03ee66e3e1ee None None] MFA Rules not processed for user `23dccda2753a4956a7f0c936682ce100`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:03.319073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b7a9c484-d49f-49cf-b3cb-03ee66e3e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:03.501692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e13842-731c-4c0d-9a04-af25ba755887 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:03.524983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:03.525750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:03.526614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:03.529984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] PATH_INFO: `/v3/projects/db2d4c3830ee477489388d5ea285947c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:03.535335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2d4c3830ee477489388d5ea285947c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:03.548077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:03.625441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 830/1683] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:03.627973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:03.628743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:03.629678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:03.682766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] MFA Rules not processed for user `507a05e50d1345d498bb0f06fe4ef2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:03.685625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:03.703343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 831/1684] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:03.709764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:03.711363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:03.742289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56ced9-7d29-4432-acbf-4cdcbbc8a413 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:03.771958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2d4c3830ee477489388d5ea285947c', 'request_id': 'req-ae182209-b363-4c91-91a1-c7bba715f66f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:03.786969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2d4c3830ee477489388d5ea285947c', 'request_id': 'req-ae182209-b363-4c91-91a1-c7bba715f66f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:03.799109 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2d4c3830ee477489388d5ea285947c', 'request_id': 'req-ae182209-b363-4c91-91a1-c7bba715f66f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:03.827046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] The token cache is being invalidate because project db2d4c3830ee477489388d5ea285947c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:03.829447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:03.832429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:03.835774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 854/1685] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:03 2022] DELETE /identity/v3/projects/db2d4c3830ee477489388d5ea285947c => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:03.836431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:03.847558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:03.878386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:03.879065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:03.879865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:03.879865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] PATH_INFO: `/v3/projects/c7ea716f663e4f74a555107bf6efbcbb` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:03.882820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ea716f663e4f74a555107bf6efbcbb)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:03.884530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:03.994921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:04.012911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:04.022200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ea716f663e4f74a555107bf6efbcbb', 'request_id': 'req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:04.040907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ea716f663e4f74a555107bf6efbcbb', 'request_id': 'req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:04.052848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae182209-b363-4c91-91a1-c7bba715f66f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:04.053453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ea716f663e4f74a555107bf6efbcbb', 'request_id': 'req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:04.087497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] The token cache is being invalidate because project c7ea716f663e4f74a555107bf6efbcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:04.090913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:04.091961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e8bb5f80-fde2-4e2d-9b38-a8ecc9bf48f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:04.099959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 832/1686] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:03 2022] DELETE /identity/v3/projects/c7ea716f663e4f74a555107bf6efbcbb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:04.099959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.099959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.100296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.164045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] MFA Rules not processed for user `23dccda2753a4956a7f0c936682ce100`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:04.167408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.195116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833864c9-d7d2-4eb2-a19f-2114fcd631c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:04.195762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833864c9-d7d2-4eb2-a19f-2114fcd631c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.196043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833864c9-d7d2-4eb2-a19f-2114fcd631c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.196315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833864c9-d7d2-4eb2-a19f-2114fcd631c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.203352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-833864c9-d7d2-4eb2-a19f-2114fcd631c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.354819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833864c9-d7d2-4eb2-a19f-2114fcd631c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:04.356317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833864c9-d7d2-4eb2-a19f-2114fcd631c0 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:04.378587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 833/1687] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:04.380101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:04.381295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.391381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 855/1688] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:04.394021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f41f-fdbc-4bea-8113-b49627cda375 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.394329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f41f-fdbc-4bea-8113-b49627cda375 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.394632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f41f-fdbc-4bea-8113-b49627cda375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.449703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f202f41f-fdbc-4bea-8113-b49627cda375 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:04.453119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f202f41f-fdbc-4bea-8113-b49627cda375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.587538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12649ff-a4f6-4ba2-9039-56584f10d829 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:04.606897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7be5dc-89ab-47cd-808f-333bef6b1f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:04.607705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7be5dc-89ab-47cd-808f-333bef6b1f80 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.608029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7be5dc-89ab-47cd-808f-333bef6b1f80 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.608465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7be5dc-89ab-47cd-808f-333bef6b1f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.614702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6d7be5dc-89ab-47cd-808f-333bef6b1f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.643061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 856/1689] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:04.647154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.647673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.648085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.718216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:04.721581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.743531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 857/1690] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:04.752006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:04.757473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.810199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f120ee1-7018-46eb-9868-b82cee6a633c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:04.828223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92febc-859c-4932-8800-478b14cb356b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:04.828975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92febc-859c-4932-8800-478b14cb356b service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.829353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92febc-859c-4932-8800-478b14cb356b service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.830430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92febc-859c-4932-8800-478b14cb356b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.834708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cf92febc-859c-4932-8800-478b14cb356b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:04.872246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92febc-859c-4932-8800-478b14cb356b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:04.874047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92febc-859c-4932-8800-478b14cb356b service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:04.882617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7be5dc-89ab-47cd-808f-333bef6b1f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:04.884266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7be5dc-89ab-47cd-808f-333bef6b1f80 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:04.901056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 858/1691] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:04.902518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a97075-a0be-4447-bf6c-2c7b739db36c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.902898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a97075-a0be-4447-bf6c-2c7b739db36c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.903804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a97075-a0be-4447-bf6c-2c7b739db36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.925859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 834/1692] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:04.927365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87eb5-9455-40c7-aa83-dd3efc6282b9 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:04.927658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87eb5-9455-40c7-aa83-dd3efc6282b9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:04.928391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87eb5-9455-40c7-aa83-dd3efc6282b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:04.992566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-84a97075-a0be-4447-bf6c-2c7b739db36c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:04.993913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-84a97075-a0be-4447-bf6c-2c7b739db36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:05.002934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-5dc87eb5-9455-40c7-aa83-dd3efc6282b9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:05.004173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5dc87eb5-9455-40c7-aa83-dd3efc6282b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:05.054195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 859/1693] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:05.061303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 835/1694] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:05.072693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87eb5-9455-40c7-aa83-dd3efc6282b9 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.073898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a97075-a0be-4447-bf6c-2c7b739db36c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.140530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87eb5-9455-40c7-aa83-dd3efc6282b9 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.145852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a97075-a0be-4447-bf6c-2c7b739db36c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.180621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.181271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.181551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.181870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.182560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:05.182894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.184467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.186007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.186789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.187068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.187340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.188012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:05.188317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.195578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.213668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:05.279739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 860/1695] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:05.279739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.280061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 836/1696] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:05.285767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.324335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0ff5-a4bc-4222-98bf-9cfa6d03d566 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.328145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e843128-db55-4388-ad13-aedfaa0691c2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.359546 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.360194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.360476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.360756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.361637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.363670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.367104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.367924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.368407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.368699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.372974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.381276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.393595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:05.483470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 837/1697] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:05 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:05.491680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.504836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 861/1698] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:05 2022] POST /identity/v3/projects => generated 379 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:05.508358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.656039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77597413-6a76-4395-baf8-70e546aa3059 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.663506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.664351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.665072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.665444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.666115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.668392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.705100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f83a-2963-41fb-ac8b-a6f559f018a5 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.724563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 862/1699] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:05 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:05.726597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.726896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.727645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.728024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.728396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.729138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.735124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.759105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0be71-bc21-4ab0-ac8b-fa652195ed23 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.773791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.774931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.775215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.778865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.781837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.781979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 838/1700] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:05 2022] POST /identity/v3/users => generated 284 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:05.783634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.791625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.815488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 863/1701] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:05.818416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3d541-f3ad-4423-bca3-5f8ca32b3d2b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.819591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.836965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.837757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.838185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.838549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.839316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.841098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.842512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52211064-ddf7-49cd-ac91-460e513cbbda admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.863162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 839/1702] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:05.864335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.878715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.879343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.879678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.880257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.881852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.884713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.887521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8eff18-7ce0-4735-bb55-d61c7046daba admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.900022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.900828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.901211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.901590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.902381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:05.904130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:05.913714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 864/1703] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:05.917760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.929338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 840/1704] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:05.933893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a8618-cafb-48f0-8a6a-20c8a0656ad5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.949595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:05.950712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564f8f-8f75-4c15-b76c-539045d70bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.952012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564f8f-8f75-4c15-b76c-539045d70bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.952118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564f8f-8f75-4c15-b76c-539045d70bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.952342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564f8f-8f75-4c15-b76c-539045d70bb2 admin admin] PATH_INFO: `/v3/projects/b206b165fc744d51afbbb9cd738cfcfc/users/78bbd2e962fe4b299ed100a78f08485e/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:05.971935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec750-869a-4a1e-be20-ce7b1fdae2ab admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:05.984554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc58c5e-b214-4d46-8fc6-d118586a85c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:05.989561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58c5e-b214-4d46-8fc6-d118586a85c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:05.989924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58c5e-b214-4d46-8fc6-d118586a85c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:05.990334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58c5e-b214-4d46-8fc6-d118586a85c4 admin admin] PATH_INFO: `/v3/projects/a934cc0e1a21482ab86a0552b2f1596e/users/169963b648194505853fd98f477d6457/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:06.001154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564f8f-8f75-4c15-b76c-539045d70bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b206b165fc744d51afbbb9cd738cfcfc, user_id=78bbd2e962fe4b299ed100a78f08485e, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:06.004334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564f8f-8f75-4c15-b76c-539045d70bb2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:06.031659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc58c5e-b214-4d46-8fc6-d118586a85c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a934cc0e1a21482ab86a0552b2f1596e, user_id=169963b648194505853fd98f477d6457, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:06.038319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc58c5e-b214-4d46-8fc6-d118586a85c4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:06.048810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 865/1705] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:05 2022] PUT /identity/v3/projects/b206b165fc744d51afbbb9cd738cfcfc/users/78bbd2e962fe4b299ed100a78f08485e/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:06.060201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d88d7-9be5-495f-aa46-d95cd378d62e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:06.060484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d88d7-9be5-495f-aa46-d95cd378d62e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:06.060762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d88d7-9be5-495f-aa46-d95cd378d62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:06.099589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 841/1706] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:05 2022] PUT /identity/v3/projects/a934cc0e1a21482ab86a0552b2f1596e/users/169963b648194505853fd98f477d6457/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:06.112438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea7b9f-c443-47b7-bb9c-70815fc0cf8f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:06.112850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea7b9f-c443-47b7-bb9c-70815fc0cf8f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:06.113224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea7b9f-c443-47b7-bb9c-70815fc0cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:06.158764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-cb6d88d7-9be5-495f-aa46-d95cd378d62e None None] MFA Rules not processed for user `78bbd2e962fe4b299ed100a78f08485e`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:06.162838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-87ea7b9f-c443-47b7-bb9c-70815fc0cf8f None None] MFA Rules not processed for user `169963b648194505853fd98f477d6457`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:06.168003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-87ea7b9f-c443-47b7-bb9c-70815fc0cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:06.171002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cb6d88d7-9be5-495f-aa46-d95cd378d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:06.288170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 842/1707] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:06.289913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea7b9f-c443-47b7-bb9c-70815fc0cf8f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:06.302586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:06.380487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 866/1708] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:06.384660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d88d7-9be5-495f-aa46-d95cd378d62e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:06.434146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:06.449562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea7b9f-c443-47b7-bb9c-70815fc0cf8f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:06.466685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:06.471949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:06.473908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:06.474633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:06.477788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:06.481285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:06.534781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 843/1709] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:06 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:06.540614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:06.583900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d88d7-9be5-495f-aa46-d95cd378d62e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:06.737764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795a7ef-34f7-4e36-badd-21830997cc11 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:06.753975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:06.754910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:06.755343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:06.755775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:06.756549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:06.759019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:06.795656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 844/1710] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:06 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:06.798009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:06.799597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:06.800040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:06.800485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:06.800827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:06.809615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:06.813409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:06.823476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635ccbc-db9e-44e0-b3bd-691a489e5db2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:06.852659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:06.856910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:06.858456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:06.859753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:06.863208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:06.865788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:06.868976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 867/1711] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:06 2022] POST /identity/v3/projects => generated 381 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:06.873917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:06.890740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 845/1712] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:06.896023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:06.912662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb33b72e-94d3-4449-891d-1bebf95975b8 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.011474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c05b63-ebe1-4ad7-abc5-504c105d5ce6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.020716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878523-e31d-47a5-9054-8569a9fc1808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.021281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878523-e31d-47a5-9054-8569a9fc1808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.021414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878523-e31d-47a5-9054-8569a9fc1808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.021732 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878523-e31d-47a5-9054-8569a9fc1808 admin admin] PATH_INFO: `/v3/projects/0481581be1d847feb63e60d747c35dab/users/4c7ebf62e04849848e803e468afc4656/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.026250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.026250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.026556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.026832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.027419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.029792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.051459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878523-e31d-47a5-9054-8569a9fc1808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0481581be1d847feb63e60d747c35dab, user_id=4c7ebf62e04849848e803e468afc4656, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.055357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878523-e31d-47a5-9054-8569a9fc1808 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.058616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:07.079707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 846/1713] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:06 2022] PUT /identity/v3/projects/0481581be1d847feb63e60d747c35dab/users/4c7ebf62e04849848e803e468afc4656/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:07.081354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 868/1714] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:06 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:07.081522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243644-3a3a-44b6-9e1d-ea8e77260237 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.082929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243644-3a3a-44b6-9e1d-ea8e77260237 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.083338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243644-3a3a-44b6-9e1d-ea8e77260237 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.086965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:07.090636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 847/1715] 10.222.0.52 () {54 vars in 912 bytes} [Fri Sep 9 14:58:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:58:07.091679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243644-3a3a-44b6-9e1d-ea8e77260237 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:07.116224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89992fb1-2ae1-4a1c-a5d6-fa8c251d22a6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.199506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243644-3a3a-44b6-9e1d-ea8e77260237 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.205749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293b05a-e848-4c83-82b6-2bfa597a97ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.208092 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b05a-e848-4c83-82b6-2bfa597a97ef admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.208855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b05a-e848-4c83-82b6-2bfa597a97ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.209457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293b05a-e848-4c83-82b6-2bfa597a97ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.210485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293b05a-e848-4c83-82b6-2bfa597a97ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.212429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293b05a-e848-4c83-82b6-2bfa597a97ef admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.224519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:07.227086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 848/1716] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:07.229262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83327357-6413-455f-bb67-f0580b74f0d0 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.229783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83327357-6413-455f-bb67-f0580b74f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.230446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83327357-6413-455f-bb67-f0580b74f0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.260866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.264071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.266024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.270308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.272480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.280431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.314553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 869/1717] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:07.314553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:07.346964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555497-a814-4252-ba36-74e9f808a4d2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.357266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-83327357-6413-455f-bb67-f0580b74f0d0 None None] MFA Rules not processed for user `b7a92823ec184a86a8ce70ffa1a4424b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:07.359878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.364381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-83327357-6413-455f-bb67-f0580b74f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:07.364729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.365833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.366810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] PATH_INFO: `/v3/projects/70fa9da570a2467db535dee638cde218/users/454395b419504c0ab18e195b9c3d1495/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.411616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fa9da570a2467db535dee638cde218, user_id=454395b419504c0ab18e195b9c3d1495, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.416207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.441932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 870/1718] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:07 2022] PUT /identity/v3/projects/70fa9da570a2467db535dee638cde218/users/454395b419504c0ab18e195b9c3d1495/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:07.443180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:07.509370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 849/1719] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:07.510283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83327357-6413-455f-bb67-f0580b74f0d0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:07.522771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83327357-6413-455f-bb67-f0580b74f0d0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.589979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae47db3-6bc5-4d88-926b-c6110f6ab253 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.610719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418f25f-9c7b-4216-9781-f55688af5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.614731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f25f-9c7b-4216-9781-f55688af5c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.619289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f25f-9c7b-4216-9781-f55688af5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.619730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418f25f-9c7b-4216-9781-f55688af5c97 admin admin] PATH_INFO: `/v3/projects/0481581be1d847feb63e60d747c35dab/users/4c7ebf62e04849848e803e468afc4656/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.623042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418f25f-9c7b-4216-9781-f55688af5c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0481581be1d847feb63e60d747c35dab, user_id=4c7ebf62e04849848e803e468afc4656, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.626069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418f25f-9c7b-4216-9781-f55688af5c97 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.650595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 871/1720] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:07 2022] PUT /identity/v3/projects/0481581be1d847feb63e60d747c35dab/users/4c7ebf62e04849848e803e468afc4656/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:07.652085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74802ab-9701-4b5c-8ad8-2b932a0a041b None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.652460 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74802ab-9701-4b5c-8ad8-2b932a0a041b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.652937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74802ab-9701-4b5c-8ad8-2b932a0a041b None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.659858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 872/1721] 10.222.0.52 () {54 vars in 912 bytes} [Fri Sep 9 14:58:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:58:07.660873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74802ab-9701-4b5c-8ad8-2b932a0a041b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:07.666449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c74802ab-9701-4b5c-8ad8-2b932a0a041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:07.676210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac0265-3893-4d33-9308-0c1701ebe131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.676972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0265-3893-4d33-9308-0c1701ebe131 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.677366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0265-3893-4d33-9308-0c1701ebe131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.677770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0265-3893-4d33-9308-0c1701ebe131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.678543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac0265-3893-4d33-9308-0c1701ebe131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.680282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac0265-3893-4d33-9308-0c1701ebe131 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.726539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 850/1722] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:07.731563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106800-3fe0-47f8-8a0e-97745682c1f2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.738013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106800-3fe0-47f8-8a0e-97745682c1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.738013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db106800-3fe0-47f8-8a0e-97745682c1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.788291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-db106800-3fe0-47f8-8a0e-97745682c1f2 None None] MFA Rules not processed for user `b7a92823ec184a86a8ce70ffa1a4424b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:07.789544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-db106800-3fe0-47f8-8a0e-97745682c1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:07.808293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74802ab-9701-4b5c-8ad8-2b932a0a041b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:07.818519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 851/1723] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:07.820004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98bcb7-ba76-4621-aaf2-eb6f410993f6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.820241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98bcb7-ba76-4621-aaf2-eb6f410993f6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.820517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98bcb7-ba76-4621-aaf2-eb6f410993f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.829247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:07.833122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:07.833548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:07.833930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:07.854535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:07.858185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:07.887898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 873/1724] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:07.889208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:07.940546 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fd98bcb7-ba76-4621-aaf2-eb6f410993f6 None None] MFA Rules not processed for user `4c7ebf62e04849848e803e468afc4656`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:07.941811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fd98bcb7-ba76-4621-aaf2-eb6f410993f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:07.978650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:08.054443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:08.094817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466eb155-6814-4ad6-ba40-15a5a399989a service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:08.103438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:08.104314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:08.104713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:08.105101 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] PATH_INFO: `/v3/projects/70fa9da570a2467db535dee638cde218/users/454395b419504c0ab18e195b9c3d1495/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:08.107362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fa9da570a2467db535dee638cde218, user_id=454395b419504c0ab18e195b9c3d1495, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:08.111471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:08.128134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 874/1725] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:07 2022] PUT /identity/v3/projects/70fa9da570a2467db535dee638cde218/users/454395b419504c0ab18e195b9c3d1495/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:08.129307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:08.137662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:08.181623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 852/1726] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:08.185348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:08.185633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:08.185908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:08.237954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] MFA Rules not processed for user `b12eee6f7bee44c6a2cb31de030e0e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:08.239537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:08.269789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b2b4a-c60a-40cf-8985-eba23b7fa997 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:08.275515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14288a5e-a05e-4e56-86d0-554b45d0a5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:08.276565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14288a5e-a05e-4e56-86d0-554b45d0a5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:08.277222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14288a5e-a05e-4e56-86d0-554b45d0a5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:08.277631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14288a5e-a05e-4e56-86d0-554b45d0a5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:08.296545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14288a5e-a05e-4e56-86d0-554b45d0a5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:08.300733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14288a5e-a05e-4e56-86d0-554b45d0a5f1 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:08.315800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 875/1727] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:08.318965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3455-afc9-4085-a5cb-301e6b7fbb0e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:08.319369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3455-afc9-4085-a5cb-301e6b7fbb0e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:08.320063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3455-afc9-4085-a5cb-301e6b7fbb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:08.404502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 853/1728] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:08.404502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:08.406032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:08.406521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-bc8a3455-afc9-4085-a5cb-301e6b7fbb0e None None] MFA Rules not processed for user `454395b419504c0ab18e195b9c3d1495`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:08.407778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bc8a3455-afc9-4085-a5cb-301e6b7fbb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:08.563558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca370b3-c031-4453-b1d8-a785ccf4998a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:08.578889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:08.579528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:08.579809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:08.580078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:08.582587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 876/1729] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:08.585821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131550a2-0a92-42af-b458-d9ab213106c2 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:08.586129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131550a2-0a92-42af-b458-d9ab213106c2 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:08.586408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131550a2-0a92-42af-b458-d9ab213106c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:08.656826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-131550a2-0a92-42af-b458-d9ab213106c2 None None] MFA Rules not processed for user `4bcd5d323ed6428d92b299218e900d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:08.658805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-131550a2-0a92-42af-b458-d9ab213106c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:08.739165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:08.746005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:08.747498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:08.772611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 854/1730] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:08.797692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 877/1731] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:08.808852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:08.814230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:08.829992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c3f33-9b89-4e56-9f2c-0b03f89bc099 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:08.834925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:08.835578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:08.835921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:08.836520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:08.854259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:08.856100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:08.888731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 855/1732] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:09.205217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131550a2-0a92-42af-b458-d9ab213106c2 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:09.215342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:09.227743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131550a2-0a92-42af-b458-d9ab213106c2 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:09.234348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d499d6-1750-4422-a36f-1967bdf21031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:09.235137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d499d6-1750-4422-a36f-1967bdf21031 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:09.235266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d499d6-1750-4422-a36f-1967bdf21031 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:09.235479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d499d6-1750-4422-a36f-1967bdf21031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:09.397269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d499d6-1750-4422-a36f-1967bdf21031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:09.397772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:09.400381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:09.409388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d499d6-1750-4422-a36f-1967bdf21031 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:09.443794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 878/1733] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:09.616009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357da6-7391-4e94-9d36-fae06dd7ead0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:09.620851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357da6-7391-4e94-9d36-fae06dd7ead0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:09.630574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2357da6-7391-4e94-9d36-fae06dd7ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:09.648673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800f0b2-53fe-46e6-9d1f-2f3257a9a1d4 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:09.657455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:09.658877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:09.659410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:09.659836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:09.662246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:09.683088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:09.687313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:09.710823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 856/1734] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:09.836936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a2357da6-7391-4e94-9d36-fae06dd7ead0 None None] MFA Rules not processed for user `2b2e394413974cd282048e582447aeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:09.840979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a2357da6-7391-4e94-9d36-fae06dd7ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:10.020786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:10.066220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 879/1735] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:10.235164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a76b-0520-4dfa-ab2e-ca88309c3b93 service placement] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:10.255457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516a813-9ae6-4e02-ad2a-6b761a2c72c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:10.258393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516a813-9ae6-4e02-ad2a-6b761a2c72c4 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:10.259232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516a813-9ae6-4e02-ad2a-6b761a2c72c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:10.259232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516a813-9ae6-4e02-ad2a-6b761a2c72c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:10.289762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516a813-9ae6-4e02-ad2a-6b761a2c72c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:10.296010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516a813-9ae6-4e02-ad2a-6b761a2c72c4 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:10.347034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 857/1736] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:11.001075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357da6-7391-4e94-9d36-fae06dd7ead0 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:11.022486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2357da6-7391-4e94-9d36-fae06dd7ead0 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:11.041670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:11.043437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:11.043715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:11.052545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:11.071243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:11.076580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:11.104436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 880/1737] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:11.389721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7f22e-5ae0-4997-90ad-e5964eadd18d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:11.391010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7f22e-5ae0-4997-90ad-e5964eadd18d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:11.391641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7f22e-5ae0-4997-90ad-e5964eadd18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:11.475539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-dac7f22e-5ae0-4997-90ad-e5964eadd18d None None] MFA Rules not processed for user `507a05e50d1345d498bb0f06fe4ef2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:11.483336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-dac7f22e-5ae0-4997-90ad-e5964eadd18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:11.716887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 858/1738] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:14.148742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:14.296843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3ebe0-70ed-419f-a710-c8ac814ad256 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:14.314134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:14.314134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:14.314134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:14.314134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] PATH_INFO: `/v3/users/169963b648194505853fd98f477d6457` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:14.316391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=169963b648194505853fd98f477d6457)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:14.318722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:14.404592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:14.472872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169963b648194505853fd98f477d6457'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:14.488822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169963b648194505853fd98f477d6457'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:14.523494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169963b648194505853fd98f477d6457'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:14.524413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169963b648194505853fd98f477d6457'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:14.539940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169963b648194505853fd98f477d6457'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:14.549667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 881/1739] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:14 2022] DELETE /identity/v3/users/169963b648194505853fd98f477d6457 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:14.553968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:14.554483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:14.554566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:14.564256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:14.615652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:14.620000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:14.638789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:14.640283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:14.840239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 859/1740] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:14.898612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:14.900214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:14.934594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a6e622-4ddd-4693-a423-ff16c831a89a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:14.974894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:14.980590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:14.981274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:14.982471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] PATH_INFO: `/v3/users/f7dcf475d2524d30a8c710d1e00782df` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:14.992498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dcf475d2524d30a8c710d1e00782df)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:15.002700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:15.095954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9bcf5-b00d-48cc-a8e6-01a043692043 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:15.114914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998478e2-564d-41bc-bda7-4f209055568a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:15.115808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998478e2-564d-41bc-bda7-4f209055568a service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:15.116247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998478e2-564d-41bc-bda7-4f209055568a service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:15.116697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998478e2-564d-41bc-bda7-4f209055568a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:15.159050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998478e2-564d-41bc-bda7-4f209055568a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:15.165234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998478e2-564d-41bc-bda7-4f209055568a service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:15.205419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 860/1741] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:15.223771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dcf475d2524d30a8c710d1e00782df'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:15.239146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dcf475d2524d30a8c710d1e00782df'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:15.270426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dcf475d2524d30a8c710d1e00782df'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:15.272896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dcf475d2524d30a8c710d1e00782df'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:15.296371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-aa5a51fc-356c-4b1f-920b-71cb61fe6544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dcf475d2524d30a8c710d1e00782df'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:15.310720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 882/1742] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:14 2022] DELETE /identity/v3/users/f7dcf475d2524d30a8c710d1e00782df => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:15.315657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:15.316190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:15.316563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:15.380477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:15.399934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:15.587115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 861/1743] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:15.723376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:15.725295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:15.726987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:15.846097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:15.852221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:15.875215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:15.935434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:15.936736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:16.050916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:16.068793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73277930-1d94-4aad-b2fa-77d0cf674ada None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:16.080395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:16.081208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:16.082415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:16.083428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:16.106527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 883/1744] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 14:58:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:16.113683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:16.123129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:16.162320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 862/1745] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:16.345180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:16.346987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:16.532186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689477b6-4ebf-4f3b-adaf-d3969eef2314 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:16.541074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:16.542592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:16.543140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:16.544701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:16.562203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:16.566503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:16.584115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 884/1746] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 14:58:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 14:58:16.822464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:16.825427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:16.865123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6045ca7-fe0a-4013-986c-86555d12ee6f service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:16.873281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:16.874581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:16.875311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:16.875845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] PATH_INFO: `/v3/projects/a934cc0e1a21482ab86a0552b2f1596e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:16.878030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a934cc0e1a21482ab86a0552b2f1596e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:16.894564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:17.021788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a934cc0e1a21482ab86a0552b2f1596e', 'request_id': 'req-ddf0121f-5789-4617-b768-ff535f0ed152'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.042164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a934cc0e1a21482ab86a0552b2f1596e', 'request_id': 'req-ddf0121f-5789-4617-b768-ff535f0ed152'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.064635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a934cc0e1a21482ab86a0552b2f1596e', 'request_id': 'req-ddf0121f-5789-4617-b768-ff535f0ed152'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.104733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] The token cache is being invalidate because project a934cc0e1a21482ab86a0552b2f1596e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:17.114902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.119773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ddf0121f-5789-4617-b768-ff535f0ed152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.124356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 863/1747] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:16 2022] DELETE /identity/v3/projects/a934cc0e1a21482ab86a0552b2f1596e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:17.129929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:17.149358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d3603-e900-4386-9ac0-5b93d69c5cf5 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:17.239229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89123-3d5b-4fb7-a45f-f98ee5ddb9bb None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:17.239548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89123-3d5b-4fb7-a45f-f98ee5ddb9bb None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:17.239837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89123-3d5b-4fb7-a45f-f98ee5ddb9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:17.348337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b8a89123-3d5b-4fb7-a45f-f98ee5ddb9bb None None] MFA Rules not processed for user `2b2e394413974cd282048e582447aeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:17.355565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b8a89123-3d5b-4fb7-a45f-f98ee5ddb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:17.482958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:17.500393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:17.502504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:17.504449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:17.504822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] PATH_INFO: `/v3/users/4c7ebf62e04849848e803e468afc4656` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:17.508571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7ebf62e04849848e803e468afc4656)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:17.511353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:17.633059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 864/1748] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:17.651533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7ebf62e04849848e803e468afc4656'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.666020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7ebf62e04849848e803e468afc4656'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.708271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7ebf62e04849848e803e468afc4656'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.709221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7ebf62e04849848e803e468afc4656'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.721643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7ebf62e04849848e803e468afc4656'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:17.732803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 885/1749] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:17 2022] DELETE /identity/v3/users/4c7ebf62e04849848e803e468afc4656 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:19.163760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377fe4e-3f42-4c05-bb16-770b87a3c8e2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:19.164285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377fe4e-3f42-4c05-bb16-770b87a3c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:19.164376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377fe4e-3f42-4c05-bb16-770b87a3c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:19.240794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e377fe4e-3f42-4c05-bb16-770b87a3c8e2 None None] MFA Rules not processed for user `4bcd5d323ed6428d92b299218e900d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:19.252331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e377fe4e-3f42-4c05-bb16-770b87a3c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:19.407827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:19.412229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:19.437055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 865/1750] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:19.783293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46f9c0-7465-4a09-9a39-812515d577e9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:19.802872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:19.804989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:19.805276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:19.805559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] PATH_INFO: `/v3/users/78bbd2e962fe4b299ed100a78f08485e` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:19.807791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] RBAC: Authorizing `identity:delete_user(user_id=78bbd2e962fe4b299ed100a78f08485e)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:19.812234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:19.989964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bbd2e962fe4b299ed100a78f08485e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.004330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bbd2e962fe4b299ed100a78f08485e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.047083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bbd2e962fe4b299ed100a78f08485e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.048247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bbd2e962fe4b299ed100a78f08485e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.066674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:20.069236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bbd2e962fe4b299ed100a78f08485e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.088234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 886/1751] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:19 2022] DELETE /identity/v3/users/78bbd2e962fe4b299ed100a78f08485e => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:20.088681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:20.088927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:20.089271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:20.136050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:20.138441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:20.140918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:20.141071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:20.187870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:20.294923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 866/1752] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:20.363974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d9b8-f2a8-4ed2-8245-a4296b1060df admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:20.378996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:20.379992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:20.381182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:20.383073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] PATH_INFO: `/v3/projects/22703cdad80748e0b48d6ce3a2819ff5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:20.389907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=22703cdad80748e0b48d6ce3a2819ff5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:20.403410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:20.412276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:20.414140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:20.579646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22703cdad80748e0b48d6ce3a2819ff5', 'request_id': 'req-26c29095-8ef9-4704-98bd-13972a1f0e4f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.601424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22703cdad80748e0b48d6ce3a2819ff5', 'request_id': 'req-26c29095-8ef9-4704-98bd-13972a1f0e4f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.605131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01e1c8-5556-4258-ba94-6f9430c2ae23 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:20.622252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22703cdad80748e0b48d6ce3a2819ff5', 'request_id': 'req-26c29095-8ef9-4704-98bd-13972a1f0e4f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.659671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] The token cache is being invalidate because project 22703cdad80748e0b48d6ce3a2819ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:20.659963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.664379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:20.668084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 887/1753] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:20 2022] DELETE /identity/v3/projects/22703cdad80748e0b48d6ce3a2819ff5 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:20.672344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:20.679165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:20.846027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539af897-21d5-4e00-b77e-a1f6e74c24cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:20.846833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af897-21d5-4e00-b77e-a1f6e74c24cc service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:20.848197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c29095-8ef9-4704-98bd-13972a1f0e4f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:20.849553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af897-21d5-4e00-b77e-a1f6e74c24cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:20.849858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af897-21d5-4e00-b77e-a1f6e74c24cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:20.854307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:20.855286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:20.855685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:20.856115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] PATH_INFO: `/v3/users/7e74897e7d98450a8160ebe848544ec3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:20.863971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-539af897-21d5-4e00-b77e-a1f6e74c24cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:20.866353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e74897e7d98450a8160ebe848544ec3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:20.873869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:20.906607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af897-21d5-4e00-b77e-a1f6e74c24cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:20.912522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af897-21d5-4e00-b77e-a1f6e74c24cc service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:20.936191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 867/1754] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:20.941044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:20.991438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e74897e7d98450a8160ebe848544ec3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:21.002886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e74897e7d98450a8160ebe848544ec3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:21.026058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:21.026535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:21.027021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:21.040412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e74897e7d98450a8160ebe848544ec3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:21.043948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e74897e7d98450a8160ebe848544ec3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:21.080852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e74897e7d98450a8160ebe848544ec3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:21.089836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] MFA Rules not processed for user `b7a92823ec184a86a8ce70ffa1a4424b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:21.093083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:21.105045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 888/1755] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:20 2022] DELETE /identity/v3/users/7e74897e7d98450a8160ebe848544ec3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:21.278968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 868/1756] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 9 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:21.341323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:21.343229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:21.372254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5436e6-5caf-49b0-b09c-789460d9658d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:21.386270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1871e80-eeb5-438c-85a7-e2227d790d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:21.387607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1871e80-eeb5-438c-85a7-e2227d790d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:21.388068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1871e80-eeb5-438c-85a7-e2227d790d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:21.391134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1871e80-eeb5-438c-85a7-e2227d790d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:21.422214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1871e80-eeb5-438c-85a7-e2227d790d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:21.427147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1871e80-eeb5-438c-85a7-e2227d790d91 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:21.474993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 889/1757] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:21.580998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:21.582805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:21.742033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:21.851018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1be65-4851-4cf0-bb3c-6d1a0459303c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:21.870478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:21.871583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:21.871979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:21.873161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] PATH_INFO: `/v3/projects/0481581be1d847feb63e60d747c35dab` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:21.874796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0481581be1d847feb63e60d747c35dab)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:21.883018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:22.012784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0481581be1d847feb63e60d747c35dab', 'request_id': 'req-78ed339f-de9c-4f99-90ed-6a362dc6342c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:22.028782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0481581be1d847feb63e60d747c35dab', 'request_id': 'req-78ed339f-de9c-4f99-90ed-6a362dc6342c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:22.038544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0481581be1d847feb63e60d747c35dab', 'request_id': 'req-78ed339f-de9c-4f99-90ed-6a362dc6342c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:22.054344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] The token cache is being invalidate because project 0481581be1d847feb63e60d747c35dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:22.054810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:22.055543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78ed339f-de9c-4f99-90ed-6a362dc6342c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:22.058348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 869/1758] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:21 2022] DELETE /identity/v3/projects/0481581be1d847feb63e60d747c35dab => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:22.064344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8717f5-9537-4b77-b2e7-272f21ade9a7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:22.065598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8717f5-9537-4b77-b2e7-272f21ade9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:22.066429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8717f5-9537-4b77-b2e7-272f21ade9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:22.129207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8f8717f5-9537-4b77-b2e7-272f21ade9a7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:22.130594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8f8717f5-9537-4b77-b2e7-272f21ade9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:22.364752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 890/1759] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:22.374407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a813ee-ecef-4147-9fb4-7b7233f79916 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:22.375183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a813ee-ecef-4147-9fb4-7b7233f79916 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:22.375842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a813ee-ecef-4147-9fb4-7b7233f79916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:22.450544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e1a813ee-ecef-4147-9fb4-7b7233f79916 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:22.466080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e1a813ee-ecef-4147-9fb4-7b7233f79916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:22.495521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 870/1760] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:22.496497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8717f5-9537-4b77-b2e7-272f21ade9a7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:22.524701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8717f5-9537-4b77-b2e7-272f21ade9a7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:22.546793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:22.547393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:22.548328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:22.548881 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:22.549776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:22.550416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:22.556612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:22.616651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 891/1761] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:22.621304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a813ee-ecef-4147-9fb4-7b7233f79916 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:22.641488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a813ee-ecef-4147-9fb4-7b7233f79916 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:22.667339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:22.669205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:22.673993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:22.674607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:22.675723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:22.681687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:22.772302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 871/1762] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:22 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:22.776016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:22.791595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ba501-6056-47ff-9876-4558b2bc1b14 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:22.959876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:22.961013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:22.961446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:22.961853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:22.962823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:22.965244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:23.014947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 892/1763] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:22 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:23.019035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:23.039507 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9af1-fc72-45d5-8983-bebee87b41fa admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:23.047099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:23.048618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:23.048893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:23.049161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:23.049812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:23.051972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:23.080860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 872/1764] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:23.085461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:23.103472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c57d3-8445-420d-8ed7-627d0604630c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:23.121635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f2833-08be-4fc6-b4d5-044a1e261f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:23.122386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f2833-08be-4fc6-b4d5-044a1e261f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:23.122554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f2833-08be-4fc6-b4d5-044a1e261f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:23.122819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f2833-08be-4fc6-b4d5-044a1e261f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:23.123478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f2833-08be-4fc6-b4d5-044a1e261f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:23.125140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f2833-08be-4fc6-b4d5-044a1e261f3c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:23.127976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:23.144048 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:23.149553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 893/1765] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:23.164054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851e6b4-fb0a-44a8-9c7b-9284823c3a51 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:23.185291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:23.185960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:23.186306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:23.186569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] PATH_INFO: `/v3/projects/302bf861f1cb4711a8fe544e32fd6108/users/b9d4486301584896a299438c75ebbe58/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:23.212903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] RBAC: Authorizing `identity:create_grant(project_id=302bf861f1cb4711a8fe544e32fd6108, user_id=b9d4486301584896a299438c75ebbe58, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:23.221967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:23.253057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 873/1766] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:23 2022] PUT /identity/v3/projects/302bf861f1cb4711a8fe544e32fd6108/users/b9d4486301584896a299438c75ebbe58/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:23.270841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4f517-40e2-44bb-bd95-01dcbae4ae50 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:23.271103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4f517-40e2-44bb-bd95-01dcbae4ae50 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:23.271380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4f517-40e2-44bb-bd95-01dcbae4ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:23.355226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7fc4f517-40e2-44bb-bd95-01dcbae4ae50 None None] MFA Rules not processed for user `b9d4486301584896a299438c75ebbe58`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:23.363861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7fc4f517-40e2-44bb-bd95-01dcbae4ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:23.657930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 894/1767] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:23.662903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:23.893584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:23.905414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be23d6-99a6-42ec-b52e-7b19188077db admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:23.918951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:23.919579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:23.919857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:23.920125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:23.926190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:23.931013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:23.998426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 874/1768] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:23 2022] POST /identity/v3/projects => generated 377 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:24.002462 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4f517-40e2-44bb-bd95-01dcbae4ae50 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:24.030114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4f517-40e2-44bb-bd95-01dcbae4ae50 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:24.300704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:24.301412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:24.301610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:24.301886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:24.302585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:24.304566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:24.350747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 895/1769] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:24 2022] POST /identity/v3/users => generated 295 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:24.354951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:24.372744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a108f-8652-4214-a1fd-ed5e42abeb47 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:24.385772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:24.386599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:24.386795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:24.387126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:24.387820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:24.392083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:24.419153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 875/1770] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:24.424376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:24.438948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61023b3-a347-4848-bea1-63d1a4b740eb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:24.448711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:24.449402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:24.452318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:24.452611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] PATH_INFO: `/v3/projects/b3ba0cdc1c994947b0144c4e99889e6d/users/5a5da3cb5c9d45468b14e12a13eb1cae/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:24.487595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ba0cdc1c994947b0144c4e99889e6d, user_id=5a5da3cb5c9d45468b14e12a13eb1cae, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:24.493787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:24.518645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 896/1771] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:24 2022] PUT /identity/v3/projects/b3ba0cdc1c994947b0144c4e99889e6d/users/5a5da3cb5c9d45468b14e12a13eb1cae/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:24.528270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:24.563954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8cf2c-7964-4879-be11-e00999343d5f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:24.647408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:24.649357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:24.713446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:24.716784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:24.717226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:24.717840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:24.720604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:24.722652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:24.752128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 876/1772] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:24.756992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:24.781529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d619-efe9-499f-ba36-805123872ea7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:24.793916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b191dd5-1245-4570-af4d-b648070add6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:24.795223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191dd5-1245-4570-af4d-b648070add6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:24.796110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191dd5-1245-4570-af4d-b648070add6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:24.796764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191dd5-1245-4570-af4d-b648070add6c admin admin] PATH_INFO: `/v3/projects/b3ba0cdc1c994947b0144c4e99889e6d/users/5a5da3cb5c9d45468b14e12a13eb1cae/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:24.798295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:24.801876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b191dd5-1245-4570-af4d-b648070add6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ba0cdc1c994947b0144c4e99889e6d, user_id=5a5da3cb5c9d45468b14e12a13eb1cae, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:24.807630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b191dd5-1245-4570-af4d-b648070add6c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:24.825348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 877/1773] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:24 2022] PUT /identity/v3/projects/b3ba0cdc1c994947b0144c4e99889e6d/users/5a5da3cb5c9d45468b14e12a13eb1cae/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:24.830883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b1782-4515-4696-91a8-6ee974feaf6f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:24.837663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:24.840888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:24.841476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:24.944521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] MFA Rules not processed for user `5a5da3cb5c9d45468b14e12a13eb1cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:24.946446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:24.981197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:24.982120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:24.982254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:24.982644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] PATH_INFO: `/v3/projects/5bd78779a70b475ab8e0112b10a00fc4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:24.984954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd78779a70b475ab8e0112b10a00fc4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:24.987457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:25.089660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 878/1774] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:25.118644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:25.121601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:25.212490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd78779a70b475ab8e0112b10a00fc4', 'request_id': 'req-d7284b02-66f8-48d5-916f-e17b350a797a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.245141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd78779a70b475ab8e0112b10a00fc4', 'request_id': 'req-d7284b02-66f8-48d5-916f-e17b350a797a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.269651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd78779a70b475ab8e0112b10a00fc4', 'request_id': 'req-d7284b02-66f8-48d5-916f-e17b350a797a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.309296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] The token cache is being invalidate because project 5bd78779a70b475ab8e0112b10a00fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:25.309978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.311861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d7284b02-66f8-48d5-916f-e17b350a797a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.319582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 897/1775] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:24 2022] DELETE /identity/v3/projects/5bd78779a70b475ab8e0112b10a00fc4 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:25.325678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925f1ad-16a3-4c1c-bb3f-f43e3cc89153 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:25.325966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925f1ad-16a3-4c1c-bb3f-f43e3cc89153 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:25.326265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925f1ad-16a3-4c1c-bb3f-f43e3cc89153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:25.331426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:25.379158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca17e49-1035-4bfc-9450-7a2566503713 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:25.405340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2925f1ad-16a3-4c1c-bb3f-f43e3cc89153 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:25.413227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2925f1ad-16a3-4c1c-bb3f-f43e3cc89153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:25.553905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:25.554702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:25.554987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:25.555426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:25.560209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:25.575955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 898/1776] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:25.580318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:25.582437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:25.582900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:25.659533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:25.666331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:25.704486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 899/1777] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:25.705851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:25.711183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:25.751740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8927-ed2d-433b-a27b-ea8576690b1d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:25.764528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:25.765393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:25.765836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:25.766338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] PATH_INFO: `/v3/projects/b206b165fc744d51afbbb9cd738cfcfc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:25.768104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b206b165fc744d51afbbb9cd738cfcfc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:25.779239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:25.793448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:25.803636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:25.828212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 879/1778] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:25.837136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:25.852430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:25.873352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037621f-1e8c-4e88-aeab-7d74c59b58ac service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:25.902951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:25.903600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:25.903882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:25.904171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:25.904827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:25.905133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:25.906851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:25.935995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b206b165fc744d51afbbb9cd738cfcfc', 'request_id': 'req-891a4662-6261-4faa-b272-f279a8302b9a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.940837 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 880/1779] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:25.966620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b206b165fc744d51afbbb9cd738cfcfc', 'request_id': 'req-891a4662-6261-4faa-b272-f279a8302b9a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.966875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:25.975891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b206b165fc744d51afbbb9cd738cfcfc', 'request_id': 'req-891a4662-6261-4faa-b272-f279a8302b9a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:25.982652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e1cb7-b3a5-411e-ba0a-0749b8439ea4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:26.013440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] The token cache is being invalidate because project b206b165fc744d51afbbb9cd738cfcfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:26.013762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:26.018627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:26.031067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 900/1780] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:25 2022] DELETE /identity/v3/projects/b206b165fc744d51afbbb9cd738cfcfc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:26.035392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:26.055775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:26.170657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:26.171762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:26.176354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:26.177680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:26.178581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:26.194131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:26.280013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 881/1781] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:25 2022] POST /identity/v3/projects => generated 365 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:26.281683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:26.286829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:26.287706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a4662-6261-4faa-b272-f279a8302b9a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:26.348693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:26.445574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:26.446936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:26.448145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:26.448513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] PATH_INFO: `/v3/users/454395b419504c0ab18e195b9c3d1495` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:26.450756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=454395b419504c0ab18e195b9c3d1495)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:26.454384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:26.489528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3c64f-4d37-40aa-8e04-b961c64d6314 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:26.504257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:26.505008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:26.505394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:26.505777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:26.506658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:26.509470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:26.562936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 882/1782] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:26 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:26.562936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:26.615153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054e126-315c-47d3-af77-60bce1e412d2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:26.632719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:26.633462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:26.636046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:26.636922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:26.638874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:26.645099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:26.654962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454395b419504c0ab18e195b9c3d1495'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:26.682627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454395b419504c0ab18e195b9c3d1495'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:26.692129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:26.692516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 883/1783] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:26.701896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:26.738179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f6bc5-e9d5-4b9c-b314-fa82677553e1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:26.745521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:26.746328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:26.746762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:26.747099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:26.750882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:26.750882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:26.751149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454395b419504c0ab18e195b9c3d1495'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:26.756321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454395b419504c0ab18e195b9c3d1495'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:26.763649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 884/1784] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:26.768378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:26.776405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:26.791477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63665fae-148a-40d9-bdc4-2a029850f9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454395b419504c0ab18e195b9c3d1495'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:26.817497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 901/1785] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:26 2022] DELETE /identity/v3/users/454395b419504c0ab18e195b9c3d1495 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:26.820189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae71f-d37a-4005-8009-b8d04f65c8ae admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:26.891993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:26.893295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:26.893699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:26.894611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] PATH_INFO: `/v3/projects/55d6d144b47643f98a7b69d3bbd96063/users/ba3b50c670ab40cc8c0a6d5b4692c6e0/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:26.927710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d6d144b47643f98a7b69d3bbd96063, user_id=ba3b50c670ab40cc8c0a6d5b4692c6e0, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:26.933316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:26.990923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 885/1786] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:26 2022] PUT /identity/v3/projects/55d6d144b47643f98a7b69d3bbd96063/users/ba3b50c670ab40cc8c0a6d5b4692c6e0/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:27.015916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695bd8a-967b-408c-8a5a-d7d796d87b1c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:27.017637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695bd8a-967b-408c-8a5a-d7d796d87b1c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:27.018949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695bd8a-967b-408c-8a5a-d7d796d87b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:27.260942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6695bd8a-967b-408c-8a5a-d7d796d87b1c None None] MFA Rules not processed for user `ba3b50c670ab40cc8c0a6d5b4692c6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:27.263244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6695bd8a-967b-408c-8a5a-d7d796d87b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:27.827656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 902/1787] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 815 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:27.835001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:28.010122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db91c8-987f-4792-ab8e-da2d0ec1634f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:28.028946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:28.029933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.030407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.033911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.034791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:28.036887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:28.101032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:28.123760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 886/1788] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:27 2022] POST /identity/v3/projects => generated 367 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:28.125131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695bd8a-967b-408c-8a5a-d7d796d87b1c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:28.147802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695bd8a-967b-408c-8a5a-d7d796d87b1c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:28.364830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:28.374675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.386348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.386812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.388650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:28.402597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:28.490843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 903/1789] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:28 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:28.492751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:28.508867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca310eaa-801e-4ff7-b70d-c55fe9196ad2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:28.527115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:28.528313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.528925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.529206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.529952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:28.534612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:28.562217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 887/1790] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:28.565855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:28.584151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061a6dd-3b10-4032-991a-4bd936e71399 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:28.592244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c77b2-6971-45f5-8c2c-ce6b6183cf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:28.593079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c77b2-6971-45f5-8c2c-ce6b6183cf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.593465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c77b2-6971-45f5-8c2c-ce6b6183cf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.593842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c77b2-6971-45f5-8c2c-ce6b6183cf19 admin admin] PATH_INFO: `/v3/projects/b6ce4105fbcd4a04ab7c34fb68470094/users/f17bc2f13a0b4693913350c5be3a3f63/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.647538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c77b2-6971-45f5-8c2c-ce6b6183cf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ce4105fbcd4a04ab7c34fb68470094, user_id=f17bc2f13a0b4693913350c5be3a3f63, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:28.649178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c77b2-6971-45f5-8c2c-ce6b6183cf19 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:28.678346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 904/1791] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:28 2022] PUT /identity/v3/projects/b6ce4105fbcd4a04ab7c34fb68470094/users/f17bc2f13a0b4693913350c5be3a3f63/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:28.679729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:28.698956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705fb58-395a-4a6f-b675-4f4108785309 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:28.707087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b9a5-49ec-4030-8da8-f93ecda066e1 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.707640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b9a5-49ec-4030-8da8-f93ecda066e1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.707997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31b9a5-49ec-4030-8da8-f93ecda066e1 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.709920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 905/1792] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:58:28.729565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a90aa9-a253-4efd-a8dd-9823230c921f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.730124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a90aa9-a253-4efd-a8dd-9823230c921f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.730496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a90aa9-a253-4efd-a8dd-9823230c921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.777565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-37a90aa9-a253-4efd-a8dd-9823230c921f None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:28.780003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-37a90aa9-a253-4efd-a8dd-9823230c921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:28.881141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:28.889520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:28.890335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.890691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.890963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.892172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:28.900110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:28.939644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 888/1793] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:28.940967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:28.976321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099112b4-a9f1-4736-b4bc-56e49122ce60 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:28.988215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:28.989024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:28.989310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:28.989584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] PATH_INFO: `/v3/projects/b6ce4105fbcd4a04ab7c34fb68470094/users/f17bc2f13a0b4693913350c5be3a3f63/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:28.996512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ce4105fbcd4a04ab7c34fb68470094, user_id=f17bc2f13a0b4693913350c5be3a3f63, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:29.007875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:29.020696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 906/1794] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:29.064023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 889/1795] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:28 2022] PUT /identity/v3/projects/b6ce4105fbcd4a04ab7c34fb68470094/users/f17bc2f13a0b4693913350c5be3a3f63/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:29.068289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:29.069793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:29.070957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:29.108713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:29.112878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:29.198246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] MFA Rules not processed for user `f17bc2f13a0b4693913350c5be3a3f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:29.201017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:29.437065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bac888-95df-41bd-9a5c-69f0f9adf63c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:29.451298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:29.451298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:29.451298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:29.452182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:29.471484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:29.476159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:29.479853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 907/1796] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:29.480964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:29.486189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:29.505940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 890/1797] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:29.507621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:29.509517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:29.621730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f9a6b-57bc-4a10-bc8f-ab0aae3e0665 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:29.628835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:29.629468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:29.629747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:29.630020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:29.637535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:29.680636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:29.715555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd5c8-0460-4089-a818-82a803908ca1 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:29.724601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:29.725521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:29.726052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:29.726475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] PATH_INFO: `/v3/projects/70fa9da570a2467db535dee638cde218` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:29.728993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fa9da570a2467db535dee638cde218)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:29.735324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:29.880295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:29.895563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:29.896823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:29.915403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 908/1798] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:29.926665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:29.930242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:29.938416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fa9da570a2467db535dee638cde218', 'request_id': 'req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:29.957183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5316c-18cc-41cc-affc-51c180d6676c service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:29.964981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fa9da570a2467db535dee638cde218', 'request_id': 'req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:29.987787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fa9da570a2467db535dee638cde218', 'request_id': 'req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:30.036006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] The token cache is being invalidate because project 70fa9da570a2467db535dee638cde218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:30.037855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:30.041489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-fc054bb1-57e4-4bf1-8cd4-9cb017c6967d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:30.047081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 891/1799] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:29 2022] DELETE /identity/v3/projects/70fa9da570a2467db535dee638cde218 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:30.052947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43d6a-5d8b-4715-aadc-db984eeaf9f5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.053263 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43d6a-5d8b-4715-aadc-db984eeaf9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.053533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43d6a-5d8b-4715-aadc-db984eeaf9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.108568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ffb1b-9f90-4ca0-ae6d-62817c24727a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.110455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffb1b-9f90-4ca0-ae6d-62817c24727a service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.110579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffb1b-9f90-4ca0-ae6d-62817c24727a service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.110796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffb1b-9f90-4ca0-ae6d-62817c24727a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.115753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-529ffb1b-9f90-4ca0-ae6d-62817c24727a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:30.143252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c4a43d6a-5d8b-4715-aadc-db984eeaf9f5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:30.144543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c4a43d6a-5d8b-4715-aadc-db984eeaf9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:30.263295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ffb1b-9f90-4ca0-ae6d-62817c24727a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.264758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ffb1b-9f90-4ca0-ae6d-62817c24727a service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.272236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 892/1800] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:30.273938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7f74-4764-4f60-8a64-353f444b1ab8 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.274207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7f74-4764-4f60-8a64-353f444b1ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.274523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb7f74-4764-4f60-8a64-353f444b1ab8 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.276359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 893/1801] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:58:30.280760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934ed8b-c354-410f-913c-fa594d5bfc48 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.282278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934ed8b-c354-410f-913c-fa594d5bfc48 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.282703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934ed8b-c354-410f-913c-fa594d5bfc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.294429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 909/1802] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:30.319600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0934ed8b-c354-410f-913c-fa594d5bfc48 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:30.321126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0934ed8b-c354-410f-913c-fa594d5bfc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:30.335900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa711e2-209b-4d27-b382-72f1c139507f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.336188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa711e2-209b-4d27-b382-72f1c139507f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.336468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa711e2-209b-4d27-b382-72f1c139507f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.341344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 894/1803] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:30.342725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934ed8b-c354-410f-913c-fa594d5bfc48 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.357379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934ed8b-c354-410f-913c-fa594d5bfc48 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:30.363134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.364093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.364808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.365192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.365953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:30.366439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.368706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.386580 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 895/1804] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:30.393163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.405591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8fa711e2-209b-4d27-b382-72f1c139507f None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:30.407700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8fa711e2-209b-4d27-b382-72f1c139507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:30.409802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa8566-15a4-4818-80e3-bebd7242e855 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:30.419601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.419932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.420328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.420706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.421594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.427575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.491530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 896/1805] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:30 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:30.497401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.506322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:30.530688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 910/1806] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:30.533067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa711e2-209b-4d27-b382-72f1c139507f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.545185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa711e2-209b-4d27-b382-72f1c139507f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:30.596930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:30.656623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:30.677359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182a4dd-3481-446d-bb4e-2a947330e88d admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:30.681667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b1a34-a742-4156-a02a-c243955dae27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.682431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1a34-a742-4156-a02a-c243955dae27 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.683342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.684739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.686078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.688369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.688933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1a34-a742-4156-a02a-c243955dae27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.689510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1a34-a742-4156-a02a-c243955dae27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.691787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-762b1a34-a742-4156-a02a-c243955dae27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:30.692447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.701302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.757658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 911/1807] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:30 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:30.758799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.771625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c03e4-734f-46d3-8384-3e0f30e04be6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:30.776678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.777419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.777975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.778550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.779138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.780858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.795658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 912/1808] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:30.796522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.807908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad2f74-2a94-4b8b-b267-32c7a924c13e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:30.814213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.815141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.815562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.815923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.816931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.819063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.833965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b1a34-a742-4156-a02a-c243955dae27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.835445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b1a34-a742-4156-a02a-c243955dae27 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.837388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 913/1809] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:30.838890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.853478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c18e-8321-43e9-84ff-a7110c29866b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:30.855636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 897/1810] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:30.878731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:30.879620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.879909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.884744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] PATH_INFO: `/v3/projects/c975f9c6c32e461ba1a5a84a9734d995/users/9a1faeecd62343a79b18adb328f97788/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.904628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c975f9c6c32e461ba1a5a84a9734d995, user_id=9a1faeecd62343a79b18adb328f97788, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:30.908165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:30.944409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 914/1811] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:30 2022] PUT /identity/v3/projects/c975f9c6c32e461ba1a5a84a9734d995/users/9a1faeecd62343a79b18adb328f97788/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:30.954641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d266-78ea-4b1a-a68f-efbf06d8cd86 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:30.955532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d266-78ea-4b1a-a68f-efbf06d8cd86 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:30.955955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179d266-78ea-4b1a-a68f-efbf06d8cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:30.992533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:30.992533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:31.016526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7179d266-78ea-4b1a-a68f-efbf06d8cd86 None None] MFA Rules not processed for user `9a1faeecd62343a79b18adb328f97788`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:31.017862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7179d266-78ea-4b1a-a68f-efbf06d8cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:31.134342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 898/1812] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:31.138544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d266-78ea-4b1a-a68f-efbf06d8cd86 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:31.167901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef298e-a5e6-40e8-853b-71473e6a3d73 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:31.183659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:31.186273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.186636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.186980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.207248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:31.208049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:31.235567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 915/1813] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:31.340466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179d266-78ea-4b1a-a68f-efbf06d8cd86 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:31.346547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:31.347565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.347880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.348259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.349086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:31.351573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:31.398743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 899/1814] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:31 2022] POST /identity/v3/projects => generated 363 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:31.402920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:31.414848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0951e-7bc6-4cae-9757-8c3badb12312 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:31.483060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:31.483714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.484136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.484411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.485358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:31.487428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:31.499774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:31.513710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 916/1815] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:31 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:31.518393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:31.535961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccd669-71b3-4d01-842a-287afa03438c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:31.541445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:31.542196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.542476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.542743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.543831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:31.545552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:31.562650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 900/1816] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:31.565387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:31.580808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c7ce3-de66-4837-bde2-775a3c8023aa admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:31.588713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:31.589432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.589742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.590020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] PATH_INFO: `/v3/projects/8eed58587d694fc18fb96a2824fe834c/users/4089648816bb48d1adc75dcd194b7290/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.607532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eed58587d694fc18fb96a2824fe834c, user_id=4089648816bb48d1adc75dcd194b7290, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:31.610329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:31.624969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 917/1817] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:31 2022] PUT /identity/v3/projects/8eed58587d694fc18fb96a2824fe834c/users/4089648816bb48d1adc75dcd194b7290/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:31.629408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:31.635901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:31.645189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b064353-48a6-4df7-993a-a90b1cc9e3d7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:31.711249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fb696-a909-4c78-8768-69042e3e220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:31.711936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb696-a909-4c78-8768-69042e3e220c admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.712140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb696-a909-4c78-8768-69042e3e220c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.712417 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fb696-a909-4c78-8768-69042e3e220c admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.713122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fb696-a909-4c78-8768-69042e3e220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:31.714829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fb696-a909-4c78-8768-69042e3e220c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:31.726909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 901/1818] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:31.731262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:31.745190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb93f53-6ea6-4a93-950a-91e880df415f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:31.751394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:31.752067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.752346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.752621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] PATH_INFO: `/v3/projects/8eed58587d694fc18fb96a2824fe834c/users/4089648816bb48d1adc75dcd194b7290/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.754933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eed58587d694fc18fb96a2824fe834c, user_id=4089648816bb48d1adc75dcd194b7290, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:31.757572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:31.769591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 918/1819] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:31 2022] PUT /identity/v3/projects/8eed58587d694fc18fb96a2824fe834c/users/4089648816bb48d1adc75dcd194b7290/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:31.779661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013ad4-46da-486e-995f-7413b4604a11 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:31.779955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013ad4-46da-486e-995f-7413b4604a11 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:31.780251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c013ad4-46da-486e-995f-7413b4604a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:31.813205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2c013ad4-46da-486e-995f-7413b4604a11 None None] MFA Rules not processed for user `4089648816bb48d1adc75dcd194b7290`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:31.815446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2c013ad4-46da-486e-995f-7413b4604a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:31.925934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 902/1820] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:31.935233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:32.003071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231c94-646b-4f16-b4e7-d8624cae8806 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:32.007062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:32.007675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:32.007952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:32.008222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:32.018519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:32.019963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:32.039184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 919/1821] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:32.140756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013ad4-46da-486e-995f-7413b4604a11 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:32.151257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c013ad4-46da-486e-995f-7413b4604a11 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:32.155899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92acb01-424c-4345-b535-bb30afa45f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:32.157150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92acb01-424c-4345-b535-bb30afa45f33 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:32.157456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92acb01-424c-4345-b535-bb30afa45f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:32.157733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92acb01-424c-4345-b535-bb30afa45f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:32.234407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92acb01-424c-4345-b535-bb30afa45f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:32.237368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92acb01-424c-4345-b535-bb30afa45f33 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:32.247080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 903/1822] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:35.168349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:35.259781 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93aa51-b927-4048-a2ee-f13364b90e25 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:35.265276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:35.266143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:35.266514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:35.266851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] PATH_INFO: `/v3/users/9a1faeecd62343a79b18adb328f97788` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:35.268546 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1faeecd62343a79b18adb328f97788)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:35.270542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:35.326885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1faeecd62343a79b18adb328f97788'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:35.336639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1faeecd62343a79b18adb328f97788'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:35.345938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:35.352702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1faeecd62343a79b18adb328f97788'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:35.353958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1faeecd62343a79b18adb328f97788'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:35.362620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1faeecd62343a79b18adb328f97788'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:35.369051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 920/1823] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:35 2022] DELETE /identity/v3/users/9a1faeecd62343a79b18adb328f97788 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:35.373376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:35.373831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:35.373934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:35.393702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:35.394947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:35.412678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:35.457032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 904/1824] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:35.466894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:35.468482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:35.527428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28285c-94d8-4965-9a58-65cd31c671c0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:35.531174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:35.532560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:35.532865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:35.533140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:35.542862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:35.544306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:35.555458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 921/1825] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:35.883934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:35.885391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:35.900136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3cd97-550b-4e47-8502-64e87433d1b8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:35.905969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:35.908029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:35.908675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:35.909150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] PATH_INFO: `/v3/projects/c975f9c6c32e461ba1a5a84a9734d995` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:35.910727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c975f9c6c32e461ba1a5a84a9734d995)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:35.913016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:35.971463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c975f9c6c32e461ba1a5a84a9734d995', 'request_id': 'req-835f86c7-02a0-413f-b000-21a8044f9e18'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:35.981192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c975f9c6c32e461ba1a5a84a9734d995', 'request_id': 'req-835f86c7-02a0-413f-b000-21a8044f9e18'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:35.989556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c975f9c6c32e461ba1a5a84a9734d995', 'request_id': 'req-835f86c7-02a0-413f-b000-21a8044f9e18'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.024494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] The token cache is being invalidate because project c975f9c6c32e461ba1a5a84a9734d995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:36.024912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.026193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.027658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 905/1826] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:35 2022] DELETE /identity/v3/projects/c975f9c6c32e461ba1a5a84a9734d995 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:36.032281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:36.043016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291fce8-eef3-494e-92ab-11e2f33c58af service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:36.114331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:36.114948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:36.115236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:36.115651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] PATH_INFO: `/v3/users/4089648816bb48d1adc75dcd194b7290` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:36.116741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4089648816bb48d1adc75dcd194b7290)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:36.118838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:36.167313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4089648816bb48d1adc75dcd194b7290'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.178562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4089648816bb48d1adc75dcd194b7290'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.192912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4089648816bb48d1adc75dcd194b7290'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.193595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4089648816bb48d1adc75dcd194b7290'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.200725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8bf35135-7930-4ee4-8821-8d342b1e1929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4089648816bb48d1adc75dcd194b7290'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.207037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 922/1827] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:36 2022] DELETE /identity/v3/users/4089648816bb48d1adc75dcd194b7290 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:36.320361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:36.321894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:36.341536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f86c7-02a0-413f-b000-21a8044f9e18 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:36.425738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:36.426653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:36.427081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:36.427528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] PATH_INFO: `/v3/users/ba3b50c670ab40cc8c0a6d5b4692c6e0` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:36.429126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3b50c670ab40cc8c0a6d5b4692c6e0)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:36.431710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:36.498830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3b50c670ab40cc8c0a6d5b4692c6e0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.501656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:36.509868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3b50c670ab40cc8c0a6d5b4692c6e0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.511267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3b50c670ab40cc8c0a6d5b4692c6e0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.521918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3b50c670ab40cc8c0a6d5b4692c6e0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.539510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3b50c670ab40cc8c0a6d5b4692c6e0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:36.546619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 906/1828] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:36 2022] DELETE /identity/v3/users/ba3b50c670ab40cc8c0a6d5b4692c6e0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:36.551673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:36.551673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:36.551955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:36.559652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:36.573457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:36.575484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:36.655705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 923/1829] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:36.701060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:36.702656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:36.770046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4548009-4aa4-4886-9533-21f007b31f3b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:36.773925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d626d82-ab6e-4d7b-bd16-f0e762245976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:36.774763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626d82-ab6e-4d7b-bd16-f0e762245976 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:36.775141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626d82-ab6e-4d7b-bd16-f0e762245976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:36.775887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d626d82-ab6e-4d7b-bd16-f0e762245976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:36.786573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d626d82-ab6e-4d7b-bd16-f0e762245976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:36.788169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d626d82-ab6e-4d7b-bd16-f0e762245976 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:36.798555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 907/1830] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:37.730074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:37.731833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:37.744571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f3cee-b78b-40a8-91cc-68a732740152 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:37.749991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:37.751196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:37.751630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:37.752043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] PATH_INFO: `/v3/projects/8eed58587d694fc18fb96a2824fe834c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:37.753512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eed58587d694fc18fb96a2824fe834c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:37.755592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:37.811419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eed58587d694fc18fb96a2824fe834c', 'request_id': 'req-74602934-c1a4-42db-9624-000f4aabf367'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:37.818418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eed58587d694fc18fb96a2824fe834c', 'request_id': 'req-74602934-c1a4-42db-9624-000f4aabf367'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:37.824900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eed58587d694fc18fb96a2824fe834c', 'request_id': 'req-74602934-c1a4-42db-9624-000f4aabf367'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:37.838247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] The token cache is being invalidate because project 8eed58587d694fc18fb96a2824fe834c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:37.838591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:37.839243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:37.840768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 924/1831] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:37 2022] DELETE /identity/v3/projects/8eed58587d694fc18fb96a2824fe834c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:37.846407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bb68-9f14-4eeb-a8e0-4b24e16c9010 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:37.846902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bb68-9f14-4eeb-a8e0-4b24e16c9010 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:37.846987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bb68-9f14-4eeb-a8e0-4b24e16c9010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:37.867278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6e28bb68-9f14-4eeb-a8e0-4b24e16c9010 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:37.868520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6e28bb68-9f14-4eeb-a8e0-4b24e16c9010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:37.907402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:37.908911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:37.946237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 908/1832] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:37.955067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f970-8a89-4254-8cbb-4143b0b552ca None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:37.955622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f970-8a89-4254-8cbb-4143b0b552ca None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:37.955838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7f970-8a89-4254-8cbb-4143b0b552ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:37.981818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fdd7f970-8a89-4254-8cbb-4143b0b552ca None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:37.983293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fdd7f970-8a89-4254-8cbb-4143b0b552ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:37.994729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 909/1833] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:37.998849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f970-8a89-4254-8cbb-4143b0b552ca None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.010299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7f970-8a89-4254-8cbb-4143b0b552ca None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.017332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602934-c1a4-42db-9624-000f4aabf367 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.018817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.019443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.019722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.019994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.020658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:38.020962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.022601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.034063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.034744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.035026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.035301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] PATH_INFO: `/v3/projects/55d6d144b47643f98a7b69d3bbd96063` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.038317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d6d144b47643f98a7b69d3bbd96063)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.040199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.051342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 910/1834] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:58:38.063315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.084419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7ef1d-9bdd-4f5a-9627-8de15da7c689 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.089500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:38.091736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.092990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.093275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.093556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.095168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.097477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.114376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d6d144b47643f98a7b69d3bbd96063', 'request_id': 'req-b8898328-f509-46cc-95d8-b41ca8b2de3a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.122367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d6d144b47643f98a7b69d3bbd96063', 'request_id': 'req-b8898328-f509-46cc-95d8-b41ca8b2de3a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.131791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d6d144b47643f98a7b69d3bbd96063', 'request_id': 'req-b8898328-f509-46cc-95d8-b41ca8b2de3a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.140346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 911/1835] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:38 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:38.145230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.154555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] The token cache is being invalidate because project 55d6d144b47643f98a7b69d3bbd96063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:38.154856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.155704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.158177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 925/1836] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:37 2022] DELETE /identity/v3/projects/55d6d144b47643f98a7b69d3bbd96063 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:38.161623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.162986 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:38.182533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:38.225335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d1988-4312-4e77-99f9-386a37b61dd4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.232479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.233025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.233310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.233584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.234253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.236469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.243514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8898328-f509-46cc-95d8-b41ca8b2de3a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.249000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.249730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.251163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.251511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] PATH_INFO: `/v3/users/f17bc2f13a0b4693913350c5be3a3f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.252910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17bc2f13a0b4693913350c5be3a3f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.255393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.270422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 912/1837] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:38 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:38.275036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.278006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:38.297902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064929-298c-4c7c-8363-95fae348f83b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.306350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.307699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.308193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.308475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.309891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.312575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.325470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17bc2f13a0b4693913350c5be3a3f63'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.331429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 913/1838] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:38.332884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.339255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17bc2f13a0b4693913350c5be3a3f63'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.349085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ea9e9-8f57-4c42-b072-1b17903452db admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.358620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfa813-c65d-4770-b23c-ae870100caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.360289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfa813-c65d-4770-b23c-ae870100caf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.360836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfa813-c65d-4770-b23c-ae870100caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.361286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfa813-c65d-4770-b23c-ae870100caf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.361513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17bc2f13a0b4693913350c5be3a3f63'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.362391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17bc2f13a0b4693913350c5be3a3f63'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.362795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfa813-c65d-4770-b23c-ae870100caf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.365023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfa813-c65d-4770-b23c-ae870100caf8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.371533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17bc2f13a0b4693913350c5be3a3f63'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:38.379996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 926/1839] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:38 2022] DELETE /identity/v3/users/f17bc2f13a0b4693913350c5be3a3f63 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:38.383605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 914/1840] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:38.387374 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.389174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:38.457070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:38.496632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba5a8c-9f36-4b65-bb49-e0fd64e18bfd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.504782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.505634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.505956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.506283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] PATH_INFO: `/v3/projects/a15971837c89449ba53952edcbe1dfb2/users/8275c45cfa4c45ee9ef70143345afb2d/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.523854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15971837c89449ba53952edcbe1dfb2, user_id=8275c45cfa4c45ee9ef70143345afb2d, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.526567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.543956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 927/1841] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:38 2022] PUT /identity/v3/projects/a15971837c89449ba53952edcbe1dfb2/users/8275c45cfa4c45ee9ef70143345afb2d/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:38.555163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d0fe-267c-4500-900a-4cfcd5559884 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.555610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d0fe-267c-4500-900a-4cfcd5559884 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.555800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d0fe-267c-4500-900a-4cfcd5559884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.588644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-aa82d0fe-267c-4500-900a-4cfcd5559884 None None] MFA Rules not processed for user `8275c45cfa4c45ee9ef70143345afb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:38.590023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-aa82d0fe-267c-4500-900a-4cfcd5559884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:38.706220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 915/1842] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:38.708240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.793722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e747770-a088-4c98-84e4-8e2a78ed0448 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.798911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.799530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.799811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.800212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.800855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.802937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.835496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 928/1843] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:38 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:38.836610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d0fe-267c-4500-900a-4cfcd5559884 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.848736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d0fe-267c-4500-900a-4cfcd5559884 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.921618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.923019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.923677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.923958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.924062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:38.924224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.924943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.927027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.943035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21cc73-6e79-40a7-8ccc-c186e37b084e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.948741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.949883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.950196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.950467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] PATH_INFO: `/v3/projects/b6ce4105fbcd4a04ab7c34fb68470094` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.951729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ce4105fbcd4a04ab7c34fb68470094)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.954746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:38.971461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 916/1844] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:38 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:38.974989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:38.985489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f79ff-7b08-4ba3-b814-1578500bb0ce admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:38.990183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:38.990791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:38.991071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:38.991340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:38.992081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:38.993667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.009922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 917/1845] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:39.011532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.018920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:39.023093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ce4105fbcd4a04ab7c34fb68470094', 'request_id': 'req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:39.028930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7409ab4-688c-48e7-8f14-07c58bbfcecd admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.030877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ce4105fbcd4a04ab7c34fb68470094', 'request_id': 'req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:39.040948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ce4105fbcd4a04ab7c34fb68470094', 'request_id': 'req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:39.055735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] The token cache is being invalidate because project b6ce4105fbcd4a04ab7c34fb68470094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:39.056040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:39.056706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-ebbbc7e2-93b8-46a4-b15e-0cef58b143ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:39.058618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 929/1846] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:38 2022] DELETE /identity/v3/projects/b6ce4105fbcd4a04ab7c34fb68470094 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:39.063815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1e7b-ae8f-4ba5-919f-81ea4b29ac70 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.064185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1e7b-ae8f-4ba5-919f-81ea4b29ac70 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.064488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1e7b-ae8f-4ba5-919f-81ea4b29ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.093341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-205a1e7b-ae8f-4ba5-919f-81ea4b29ac70 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:39.094897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-205a1e7b-ae8f-4ba5-919f-81ea4b29ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:39.107247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.108036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.108404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.108768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] PATH_INFO: `/v3/projects/be9c472105544954b5ec5836cf525594/users/095e7eedc021476696b4537b8f5dc71f/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.124434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:39.136488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9c472105544954b5ec5836cf525594, user_id=095e7eedc021476696b4537b8f5dc71f, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.139962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.176283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 918/1847] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:39 2022] PUT /identity/v3/projects/be9c472105544954b5ec5836cf525594/users/095e7eedc021476696b4537b8f5dc71f/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:39.181522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.183936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:39.196864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 930/1848] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:39.208702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251985-7c71-4792-bdf1-152f1ff0f205 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.209038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251985-7c71-4792-bdf1-152f1ff0f205 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.209260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06251985-7c71-4792-bdf1-152f1ff0f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.230709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-06251985-7c71-4792-bdf1-152f1ff0f205 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:39.232399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-06251985-7c71-4792-bdf1-152f1ff0f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:39.289223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4ca2b-ccc6-4ef4-9a77-30aa33f1a1a7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.295882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.297413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.297701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.297957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.298913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.300527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.319640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 919/1849] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:39.320704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.338652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 931/1850] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:39.340041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee924baa-9fcd-4199-b18d-ced2ceb350cf admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.343170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06251985-7c71-4792-bdf1-152f1ff0f205 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.348608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadaf42-fb23-4c60-bbd4-6087a855be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.349720 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadaf42-fb23-4c60-bbd4-6087a855be7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.350304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadaf42-fb23-4c60-bbd4-6087a855be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.352213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadaf42-fb23-4c60-bbd4-6087a855be7b admin admin] PATH_INFO: `/v3/projects/be9c472105544954b5ec5836cf525594/users/095e7eedc021476696b4537b8f5dc71f/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.355526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadaf42-fb23-4c60-bbd4-6087a855be7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9c472105544954b5ec5836cf525594, user_id=095e7eedc021476696b4537b8f5dc71f, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.355650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06251985-7c71-4792-bdf1-152f1ff0f205 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.359227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadaf42-fb23-4c60-bbd4-6087a855be7b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.361455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.362196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.362547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.363053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.363776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:39.364146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.365934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.387106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 920/1851] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:39 2022] PUT /identity/v3/projects/be9c472105544954b5ec5836cf525594/users/095e7eedc021476696b4537b8f5dc71f/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:39.389968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.393621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.393923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.397482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 932/1852] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:39.400215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.421233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9f9c1-eda7-4f55-85b1-4abbf4e29645 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.443638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] MFA Rules not processed for user `095e7eedc021476696b4537b8f5dc71f`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:39.444876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:39.521945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.523457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.524622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.524982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.526213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.528361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.536429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:39.558507 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 921/1853] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:39.571868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.577053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:39.586362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 933/1854] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:39 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:39.590875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.652345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2b8b-ae18-4bdf-beca-720dccea6b4b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.692726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:39.762967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.767024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.767725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.768365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.789515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bb52f-7eeb-4a90-b624-fa284230674b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.814510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.815177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.815690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.815966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.816720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.821413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.876030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 934/1855] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:39 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:39.885851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:39.926577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec45ca-188a-4d71-80fd-a58bd8a89187 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:39.936835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.940470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.945724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:39.946487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:39.946659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:39.946921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:39.947562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:39.949220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:39.969053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 922/1856] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:40.003260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 935/1857] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:40.004339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:40.023387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bd27b-2d27-4530-a0fa-fb25c9bfa2d8 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:40.034274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259181e-eb7e-494b-83b3-acb0497019bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:40.034971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259181e-eb7e-494b-83b3-acb0497019bf admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.035259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259181e-eb7e-494b-83b3-acb0497019bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.035534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259181e-eb7e-494b-83b3-acb0497019bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.036184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259181e-eb7e-494b-83b3-acb0497019bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:40.038159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259181e-eb7e-494b-83b3-acb0497019bf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:40.063594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 923/1858] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:40.065725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:40.076490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddb08a-1255-4cf8-ac81-90122bc93240 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:40.096832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:40.102414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.104853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.106121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] PATH_INFO: `/v3/projects/3ecfd1006b564227b568f61bd98005b3/users/b4cf2f8a405045db9e0dc18a675ed55c/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.136376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecfd1006b564227b568f61bd98005b3, user_id=b4cf2f8a405045db9e0dc18a675ed55c, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:40.139501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:40.165346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 936/1859] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:40 2022] PUT /identity/v3/projects/3ecfd1006b564227b568f61bd98005b3/users/b4cf2f8a405045db9e0dc18a675ed55c/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:40.168595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3529-c210-4ce4-9ea5-911e3ff92376 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.168595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3529-c210-4ce4-9ea5-911e3ff92376 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.168595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d3529-c210-4ce4-9ea5-911e3ff92376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.220114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-283d3529-c210-4ce4-9ea5-911e3ff92376 None None] MFA Rules not processed for user `b4cf2f8a405045db9e0dc18a675ed55c`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:40.221833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-283d3529-c210-4ce4-9ea5-911e3ff92376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:40.296436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:40.325811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 924/1860] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:40.338121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:40.339961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:40.394269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d3529-c210-4ce4-9ea5-911e3ff92376 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:40.423115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc70c1-7420-4a45-901a-f64437eea4ae admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:40.426924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3849cb5e321d48c88f0e19121ec7e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:40.427526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.427801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.428066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.436521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:40.438512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:40.447694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 937/1861] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:40.458108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d3529-c210-4ce4-9ea5-911e3ff92376 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:40.462652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e7eedc021476696b4537b8f5dc71f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9c472105544954b5ec5836cf525594', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:40.463257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.463535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.463806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.464449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:40.464756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:40.466388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:40.481663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 925/1862] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:58:40.482778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:40.494108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207db25-0be0-4ef8-98ba-67fcd371766f service glance] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:40.498727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e7eedc021476696b4537b8f5dc71f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9c472105544954b5ec5836cf525594', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:40.499317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.499603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.500406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.501037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:40.503241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:40.537807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 938/1863] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:40 2022] POST /identity/v3/projects => generated 353 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:40.539169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:40.550369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89e199-f0d4-44f6-8d46-f6b547d1cf20 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:40.619078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e7eedc021476696b4537b8f5dc71f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9c472105544954b5ec5836cf525594', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:40.619895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.620176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.620445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.621181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:40.621380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:40.623095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:40.639627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 926/1864] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:40.674332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:40.688944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535516ff-1fb3-4b56-b367-984dfc5c91ed tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:40.693929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '095e7eedc021476696b4537b8f5dc71f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be9c472105544954b5ec5836cf525594', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:40.694599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:40.694884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:40.695160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] PATH_INFO: `/v3/projects/9003239d024f4e46905cd9e4609706e5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:40.696752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9003239d024f4e46905cd9e4609706e5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:40.698717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:40.748298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9003239d024f4e46905cd9e4609706e5', 'request_id': 'req-d1afae2c-af97-4437-8aa9-5f9499117f54'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:40.749466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:40.756003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9003239d024f4e46905cd9e4609706e5', 'request_id': 'req-d1afae2c-af97-4437-8aa9-5f9499117f54'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:40.764085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9003239d024f4e46905cd9e4609706e5', 'request_id': 'req-d1afae2c-af97-4437-8aa9-5f9499117f54'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:40.777655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] The token cache is being invalidate because project 9003239d024f4e46905cd9e4609706e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:40.777945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:40.778671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d1afae2c-af97-4437-8aa9-5f9499117f54 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:40.780650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 939/1865] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:40 2022] DELETE /identity/v3/projects/9003239d024f4e46905cd9e4609706e5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:41.061577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:41.079155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:41.177767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70a0e8-70ba-4a05-bcfc-e09e753f9e83 tempest-VolumeQuotaClassesTest-99422184 tempest-VolumeQuotaClassesTest-99422184-project-admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:41.190452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:41.313606 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:41.314558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:41.314736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:41.315013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] PATH_INFO: `/v3/users/8275c45cfa4c45ee9ef70143345afb2d` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:41.320775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8275c45cfa4c45ee9ef70143345afb2d)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:41.323404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:41.442302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8275c45cfa4c45ee9ef70143345afb2d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:41.475439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8275c45cfa4c45ee9ef70143345afb2d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:41.476071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8275c45cfa4c45ee9ef70143345afb2d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:41.502272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8275c45cfa4c45ee9ef70143345afb2d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:41.547909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f6bd9bfa-b163-49a7-8761-aa7a710e2133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8275c45cfa4c45ee9ef70143345afb2d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:41.558230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 927/1866] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:41 2022] DELETE /identity/v3/users/8275c45cfa4c45ee9ef70143345afb2d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:41.563417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:41.563943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:41.563943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:41.587825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:41.589146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:41.646289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845425-46db-495b-bd1e-3768f94ec4b2 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:41.646719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845425-46db-495b-bd1e-3768f94ec4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:41.647916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5845425-46db-495b-bd1e-3768f94ec4b2 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:41.649480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 928/1867] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:58:41.664752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339f0e-c336-4447-99c3-810d2115549a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:41.665751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339f0e-c336-4447-99c3-810d2115549a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:41.666451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23339f0e-c336-4447-99c3-810d2115549a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:41.714343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-23339f0e-c336-4447-99c3-810d2115549a None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:41.715629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-23339f0e-c336-4447-99c3-810d2115549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:41.739951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 940/1868] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:41.749766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:41.751453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:41.829598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 929/1869] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:41.845187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1db253-f27e-46c0-9bc6-37e62efffce8 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:41.847544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23339f0e-c336-4447-99c3-810d2115549a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:41.849080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-23339f0e-c336-4447-99c3-810d2115549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:41.849656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:41.850457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:41.850818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:41.851220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:41.864622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23339f0e-c336-4447-99c3-810d2115549a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:41.868145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:41.870020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:41.871130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:41.871887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:41.872241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:41.872583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:41.881042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 941/1870] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:41.883649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:41.885638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:41.900463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 930/1871] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:42.306736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:42.308493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:42.334144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0509abe-09d8-4df1-be8b-146b8bf8a7a7 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:42.348870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:42.350298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:42.362402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:42.362402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] PATH_INFO: `/v3/projects/a15971837c89449ba53952edcbe1dfb2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:42.362402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15971837c89449ba53952edcbe1dfb2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:42.362402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:42.428368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15971837c89449ba53952edcbe1dfb2', 'request_id': 'req-b761278f-74e0-4894-86e0-85d1c48e1c31'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.434110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15971837c89449ba53952edcbe1dfb2', 'request_id': 'req-b761278f-74e0-4894-86e0-85d1c48e1c31'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.440647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15971837c89449ba53952edcbe1dfb2', 'request_id': 'req-b761278f-74e0-4894-86e0-85d1c48e1c31'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.454421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] The token cache is being invalidate because project a15971837c89449ba53952edcbe1dfb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:42.454710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.455343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.457119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 942/1872] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:42 2022] DELETE /identity/v3/projects/a15971837c89449ba53952edcbe1dfb2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:42.461099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:42.472323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae70f5-7ff2-4e95-90f4-1aceeaca5220 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:42.480364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:42.536219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:42.537311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:42.537311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:42.537594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] PATH_INFO: `/v3/users/095e7eedc021476696b4537b8f5dc71f` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:42.538588 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=095e7eedc021476696b4537b8f5dc71f)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:42.540709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:42.590714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095e7eedc021476696b4537b8f5dc71f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.599253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095e7eedc021476696b4537b8f5dc71f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.600287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095e7eedc021476696b4537b8f5dc71f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.608214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095e7eedc021476696b4537b8f5dc71f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.623561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-08e1777c-2604-43be-9d17-f12f95b2d1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095e7eedc021476696b4537b8f5dc71f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:42.631408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 931/1873] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:42 2022] DELETE /identity/v3/users/095e7eedc021476696b4537b8f5dc71f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:43.008944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.010867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:43.021683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:43.026732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761278f-74e0-4894-86e0-85d1c48e1c31 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.107726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.108380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.108660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.108935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] PATH_INFO: `/v3/projects/be9c472105544954b5ec5836cf525594` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.110803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9c472105544954b5ec5836cf525594)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.112891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.160655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9c472105544954b5ec5836cf525594', 'request_id': 'req-69ef15c7-917c-4d53-91a5-9d11c09d86e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:43.166207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9c472105544954b5ec5836cf525594', 'request_id': 'req-69ef15c7-917c-4d53-91a5-9d11c09d86e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:43.172746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9c472105544954b5ec5836cf525594', 'request_id': 'req-69ef15c7-917c-4d53-91a5-9d11c09d86e3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:43.184940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] The token cache is being invalidate because project be9c472105544954b5ec5836cf525594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:43.185224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:43.185886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-69ef15c7-917c-4d53-91a5-9d11c09d86e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:43.188091 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 943/1874] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:43 2022] DELETE /identity/v3/projects/be9c472105544954b5ec5836cf525594 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:43.193451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295577bc-06bf-45e3-90cf-4d5323739ac9 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.193809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295577bc-06bf-45e3-90cf-4d5323739ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.194171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295577bc-06bf-45e3-90cf-4d5323739ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.215595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-295577bc-06bf-45e3-90cf-4d5323739ac9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:43.216814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-295577bc-06bf-45e3-90cf-4d5323739ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:43.276577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 932/1875] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:43.284601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7b0f-fb89-4499-a6ae-b6d6c2821109 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.284884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7b0f-fb89-4499-a6ae-b6d6c2821109 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.285152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f7b0f-fb89-4499-a6ae-b6d6c2821109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.305050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b50f7b0f-fb89-4499-a6ae-b6d6c2821109 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:43.306278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b50f7b0f-fb89-4499-a6ae-b6d6c2821109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:43.314796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 944/1876] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:43.318906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295577bc-06bf-45e3-90cf-4d5323739ac9 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.329226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295577bc-06bf-45e3-90cf-4d5323739ac9 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.334464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.335111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.335395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.335670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.336326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:43.336630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.338266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.353714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 933/1877] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:43.355500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f7b0f-fb89-4499-a6ae-b6d6c2821109 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.365094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f7b0f-fb89-4499-a6ae-b6d6c2821109 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.371682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.380724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.380989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.381316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.381978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.384179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.422032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 945/1878] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:43 2022] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:43.423492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.437960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9256-ea61-4283-acee-05320e427624 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.460515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:43.524429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.525260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.525856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.525856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.527017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.528990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.563127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 934/1879] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:43 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:43.564773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.592761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c14ec-2e62-45fd-ba0f-79cde30d3541 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.602727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.603342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.603622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.603893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.604864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.606168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.617679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 946/1880] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:43.622960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.634822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb8458-1c7b-48db-a029-4cc5f145a481 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.648082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed08661-cedc-4094-8fec-442a1477a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.648716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08661-cedc-4094-8fec-442a1477a809 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.649491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08661-cedc-4094-8fec-442a1477a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.649777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed08661-cedc-4094-8fec-442a1477a809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.651063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08661-cedc-4094-8fec-442a1477a809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.652736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed08661-cedc-4094-8fec-442a1477a809 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.666123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 935/1881] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:43.670804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.685600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e9447-dcca-4299-bd01-111fd22617ff admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.691133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.691814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.692092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.692363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] PATH_INFO: `/v3/projects/6b65889b78f44286bc020469e6df0aa3/users/658aa7be1abc481abcbc4758729cb632/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.712677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b65889b78f44286bc020469e6df0aa3, user_id=658aa7be1abc481abcbc4758729cb632, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.715559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.754898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 947/1882] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:43 2022] PUT /identity/v3/projects/6b65889b78f44286bc020469e6df0aa3/users/658aa7be1abc481abcbc4758729cb632/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:43.757739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db1f-f866-4908-a76c-e9e1221da258 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.758104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db1f-f866-4908-a76c-e9e1221da258 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.758450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db1f-f866-4908-a76c-e9e1221da258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.797577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0370db1f-f866-4908-a76c-e9e1221da258 None None] MFA Rules not processed for user `658aa7be1abc481abcbc4758729cb632`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:43.798838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0370db1f-f866-4908-a76c-e9e1221da258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:43.866932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 936/1883] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:43.871855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:43.908929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:43.945717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f57c4-0f06-4c32-89aa-a0a7095ccf34 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:43.950721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:43.951457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:43.951735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:43.952003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:43.952637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:43.955129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:43.989093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 948/1884] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:43 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:43.992799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db1f-f866-4908-a76c-e9e1221da258 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.004817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db1f-f866-4908-a76c-e9e1221da258 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.065621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.066273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.066554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.066822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.067485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.069599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.095849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 937/1885] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:43 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:44.098529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.111068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b543af-7645-4b4e-bb5a-04b9b27aa7e6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.114189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.115609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.116325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:44.116438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.116438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.116684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.117313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.119075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.129159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abafe2d-c3a4-4c54-ba51-0aa1223c4fa2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.135548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.139013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 949/1886] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:44.139269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.139269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.139269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] PATH_INFO: `/v3/users/b9d4486301584896a299438c75ebbe58` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.139269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d4486301584896a299438c75ebbe58)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.140001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.143517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.151858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:44.158358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f29a3-2d89-442d-be9b-782245448c16 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.163176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.164018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.164385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.164687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] PATH_INFO: `/v3/projects/9ac7a519fa9b40d7bbf0c64e22cfdcd4/users/017e90e71db4419e9a2d3972bce8c61a/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.183724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac7a519fa9b40d7bbf0c64e22cfdcd4, user_id=017e90e71db4419e9a2d3972bce8c61a, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.186395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.191856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d4486301584896a299438c75ebbe58'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:44.199216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d4486301584896a299438c75ebbe58'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:44.200021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d4486301584896a299438c75ebbe58'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:44.200324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 950/1887] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:44 2022] PUT /identity/v3/projects/9ac7a519fa9b40d7bbf0c64e22cfdcd4/users/017e90e71db4419e9a2d3972bce8c61a/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:44.204453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.206057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:44.208122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d4486301584896a299438c75ebbe58'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:44.224340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b08bff18-baa3-456d-94a3-7faed40957b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d4486301584896a299438c75ebbe58'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:44.230366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 938/1888] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:44 2022] DELETE /identity/v3/users/b9d4486301584896a299438c75ebbe58 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:44.235299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.235585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.235860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.255468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:44.256949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:44.277928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729e343-b707-4577-9765-beb47a76f84d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.322178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 939/1889] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:44.333353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.334701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:44.337875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.338608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.338798 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.339160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.339866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.341501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.357056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 951/1890] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:44.358121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.368117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44040a3f-392c-4ae9-ba28-b5ee65206593 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.372812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef46e7-320d-4d9d-8903-fc9db55c5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.373449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef46e7-320d-4d9d-8903-fc9db55c5a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.373841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef46e7-320d-4d9d-8903-fc9db55c5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.374143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef46e7-320d-4d9d-8903-fc9db55c5a78 admin admin] PATH_INFO: `/v3/projects/9ac7a519fa9b40d7bbf0c64e22cfdcd4/users/017e90e71db4419e9a2d3972bce8c61a/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.377552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef46e7-320d-4d9d-8903-fc9db55c5a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac7a519fa9b40d7bbf0c64e22cfdcd4, user_id=017e90e71db4419e9a2d3972bce8c61a, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.380769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef46e7-320d-4d9d-8903-fc9db55c5a78 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.395392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 952/1891] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:44 2022] PUT /identity/v3/projects/9ac7a519fa9b40d7bbf0c64e22cfdcd4/users/017e90e71db4419e9a2d3972bce8c61a/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:44.399710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cf3e0-2572-483c-a8cb-8b369f9b9239 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.407139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.407429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.407706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.431553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:44.440648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] MFA Rules not processed for user `017e90e71db4419e9a2d3972bce8c61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:44.442016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:44.445075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:44.456319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.457848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.458165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.458443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.519828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 953/1892] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:44.528292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.529992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.530481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.532397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:44.539872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 940/1893] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:44.610281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc7586-f261-4e55-8f78-8389425db963 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.614431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.615106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.615388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.615664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.630185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.630185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.644263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 954/1894] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:44.772615 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:44.786245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2711c-cdad-41d4-88d4-814e163b1d67 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:44.793123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:44.794149 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:44.794149 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:44.794431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:44.797625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:44.891602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:44.893715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:44.904354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 941/1895] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:45.313191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:45.314761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:45.338437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b16a8-92dd-4181-91cd-065d554ab1a2 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:45.362132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:45.362132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:45.362132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:45.362132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] PATH_INFO: `/v3/projects/302bf861f1cb4711a8fe544e32fd6108` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:45.362652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=302bf861f1cb4711a8fe544e32fd6108)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:45.362652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:45.480080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302bf861f1cb4711a8fe544e32fd6108', 'request_id': 'req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.483208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302bf861f1cb4711a8fe544e32fd6108', 'request_id': 'req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.493670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302bf861f1cb4711a8fe544e32fd6108', 'request_id': 'req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.510717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] The token cache is being invalidate because project 302bf861f1cb4711a8fe544e32fd6108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:45.511178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.511922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.513771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 955/1896] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:45 2022] DELETE /identity/v3/projects/302bf861f1cb4711a8fe544e32fd6108 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:45.518434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:45.530057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c1d4f-63f2-43c9-913c-b21bddfeb818 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:45.612716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:45.613487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:45.618407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:45.618867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] PATH_INFO: `/v3/users/5a5da3cb5c9d45468b14e12a13eb1cae` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:45.620936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5da3cb5c9d45468b14e12a13eb1cae)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:45.622928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:45.689144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:45.710028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5da3cb5c9d45468b14e12a13eb1cae'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.720135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5da3cb5c9d45468b14e12a13eb1cae'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.721026 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5da3cb5c9d45468b14e12a13eb1cae'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.729887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5da3cb5c9d45468b14e12a13eb1cae'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.743123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-361da11d-ef29-43a2-b254-80822be72c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5da3cb5c9d45468b14e12a13eb1cae'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:45.749388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 942/1897] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:45 2022] DELETE /identity/v3/users/5a5da3cb5c9d45468b14e12a13eb1cae => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:46.023081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:46.024516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:46.038389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242cf8e-bbc0-4f11-80df-87f89cf5ef6f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:46.058019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:46.098628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:46.099263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.099542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.099842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] PATH_INFO: `/v3/projects/b3ba0cdc1c994947b0144c4e99889e6d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.100965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ba0cdc1c994947b0144c4e99889e6d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:46.102934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:46.150946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ba0cdc1c994947b0144c4e99889e6d', 'request_id': 'req-e0981092-75ff-432e-9ea7-2479e20fa421'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:46.156691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ba0cdc1c994947b0144c4e99889e6d', 'request_id': 'req-e0981092-75ff-432e-9ea7-2479e20fa421'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:46.162875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ba0cdc1c994947b0144c4e99889e6d', 'request_id': 'req-e0981092-75ff-432e-9ea7-2479e20fa421'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:46.176855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] The token cache is being invalidate because project b3ba0cdc1c994947b0144c4e99889e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:46.177145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:46.177779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0981092-75ff-432e-9ea7-2479e20fa421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:46.179361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 956/1898] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:46 2022] DELETE /identity/v3/projects/b3ba0cdc1c994947b0144c4e99889e6d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:46.184663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20d84e-f3db-4288-8764-631310a9cfac None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.184946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20d84e-f3db-4288-8764-631310a9cfac None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.185223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20d84e-f3db-4288-8764-631310a9cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.207803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ae20d84e-f3db-4288-8764-631310a9cfac None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:46.209201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ae20d84e-f3db-4288-8764-631310a9cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:46.304262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 943/1899] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:46.305158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0315986-21d8-465a-b97b-aefc1631edac None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.305442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0315986-21d8-465a-b97b-aefc1631edac None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.305712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0315986-21d8-465a-b97b-aefc1631edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.338350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c0315986-21d8-465a-b97b-aefc1631edac None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:46.340184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c0315986-21d8-465a-b97b-aefc1631edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:46.348902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 957/1900] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:46.358344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20d84e-f3db-4288-8764-631310a9cfac None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:46.365680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20d84e-f3db-4288-8764-631310a9cfac None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:46.373060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:46.373060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.373060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.373431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.373965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:46.374298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:46.376531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:46.391718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 944/1901] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:46.396090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0315986-21d8-465a-b97b-aefc1631edac None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:46.407288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0315986-21d8-465a-b97b-aefc1631edac None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:46.412584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:46.413768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.414045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.414766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.418364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:46.428459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:46.454103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 958/1902] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:46 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:46.455246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:46.468933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a63c96-2f46-4d5b-ba4b-16e7fc9cbe59 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:46.552041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:46.552952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.553340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.554035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.554847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:46.557885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:46.591373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 945/1903] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:46 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:46.596393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:46.607969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc59171-66d2-4ad0-8687-11ed8eb0b2c5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:46.614281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:46.615429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.615927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.616441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.617369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:46.619302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:46.635223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 959/1904] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:46.636940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:46.648483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c702946-cf06-4aea-ae78-ba1660eae83b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:46.653556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049fa3c-c8ba-45cf-8111-2a5b7e612d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:46.654195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049fa3c-c8ba-45cf-8111-2a5b7e612d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.656522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049fa3c-c8ba-45cf-8111-2a5b7e612d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.656802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049fa3c-c8ba-45cf-8111-2a5b7e612d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.657661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049fa3c-c8ba-45cf-8111-2a5b7e612d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:46.659890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049fa3c-c8ba-45cf-8111-2a5b7e612d20 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:46.672337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 946/1905] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:46.676700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:46.699735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4047-f5b1-4007-96c6-d05c14b7f180 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:46.716390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:46.717059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.717336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.717833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] PATH_INFO: `/v3/projects/408e8a117df84f0ebf1dde13030e8e87/users/2b0c5ab3933046a481bbfe83e3289eb6/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.744376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] RBAC: Authorizing `identity:create_grant(project_id=408e8a117df84f0ebf1dde13030e8e87, user_id=2b0c5ab3933046a481bbfe83e3289eb6, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:46.748053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:46.782052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 960/1906] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:46 2022] PUT /identity/v3/projects/408e8a117df84f0ebf1dde13030e8e87/users/2b0c5ab3933046a481bbfe83e3289eb6/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:46.801445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed5c1-018e-4c50-9f86-c51204483abd None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:46.801950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed5c1-018e-4c50-9f86-c51204483abd None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:46.802528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed5c1-018e-4c50-9f86-c51204483abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:46.862239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ff1ed5c1-018e-4c50-9f86-c51204483abd None None] MFA Rules not processed for user `2b0c5ab3933046a481bbfe83e3289eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:46.863656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ff1ed5c1-018e-4c50-9f86-c51204483abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:46.868942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:46.969877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 947/1907] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:46.974453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:47.025552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:47.041151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866808-61b9-4481-a3ab-8b2a4df3610d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:47.047875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:47.048648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.048923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.049192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.049835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:47.051772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:47.079501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 961/1908] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:46 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:47.083737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ed5c1-018e-4c50-9f86-c51204483abd None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:47.096912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ed5c1-018e-4c50-9f86-c51204483abd None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:47.157084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:47.157693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.157968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.158501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.159169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:47.161201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:47.184083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 948/1909] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:47 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:47.188706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:47.198875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5d9dc-0c53-4b34-a031-275917fb6254 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:47.204249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:47.204841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.205122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.205411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.206027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:47.207899 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:47.219443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 962/1910] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:47.223605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:47.233502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f935d9-ed6e-4e87-9c6b-ea3cb15a7ae1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:47.238650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:47.239295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.239577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.239919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] PATH_INFO: `/v3/projects/7b8a8c79998a4e27b83eb1249c7aaf8a/users/86a0046e08d7446787d37e19bd14162b/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.255533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8a8c79998a4e27b83eb1249c7aaf8a, user_id=86a0046e08d7446787d37e19bd14162b, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:47.258675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:47.273016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 949/1911] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:47 2022] PUT /identity/v3/projects/7b8a8c79998a4e27b83eb1249c7aaf8a/users/86a0046e08d7446787d37e19bd14162b/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:47.277119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:47.287212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222ff24-c338-4b52-9373-b23fc70b676c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:47.343662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309296e-9663-4119-9099-e04ec503443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:47.344321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309296e-9663-4119-9099-e04ec503443c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.344550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309296e-9663-4119-9099-e04ec503443c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.344822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309296e-9663-4119-9099-e04ec503443c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.345471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309296e-9663-4119-9099-e04ec503443c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:47.347135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309296e-9663-4119-9099-e04ec503443c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:47.360643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 963/1912] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:47.363418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:47.375418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e130a09-6030-42a5-8dbe-a93d46cf18c8 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:47.381762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:47.382928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.383423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.383973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] PATH_INFO: `/v3/projects/7b8a8c79998a4e27b83eb1249c7aaf8a/users/86a0046e08d7446787d37e19bd14162b/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.387350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8a8c79998a4e27b83eb1249c7aaf8a, user_id=86a0046e08d7446787d37e19bd14162b, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:47.392828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:47.408462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 950/1913] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:47 2022] PUT /identity/v3/projects/7b8a8c79998a4e27b83eb1249c7aaf8a/users/86a0046e08d7446787d37e19bd14162b/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:47.420018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab7c79-d367-4e8b-b74c-e46707d42161 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.420306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab7c79-d367-4e8b-b74c-e46707d42161 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.420587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab7c79-d367-4e8b-b74c-e46707d42161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.458844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7aab7c79-d367-4e8b-b74c-e46707d42161 None None] MFA Rules not processed for user `86a0046e08d7446787d37e19bd14162b`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:47.460571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7aab7c79-d367-4e8b-b74c-e46707d42161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:47.572036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 964/1914] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:47.582562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:47.584758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:47.667519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4b5c5-da0a-41b3-8e1c-c23c0a1fb32e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:47.672210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:47.673039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:47.673418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:47.673760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:47.688985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:47.760241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:47.762646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:47.787333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 951/1915] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:49.517537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab7c79-d367-4e8b-b74c-e46707d42161 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:49.527563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab7c79-d367-4e8b-b74c-e46707d42161 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:49.533154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eade2c-837d-4f1d-b75e-118aba770a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:49.533902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eade2c-837d-4f1d-b75e-118aba770a76 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:49.534277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eade2c-837d-4f1d-b75e-118aba770a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:49.534616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eade2c-837d-4f1d-b75e-118aba770a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:49.544291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eade2c-837d-4f1d-b75e-118aba770a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:49.546135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eade2c-837d-4f1d-b75e-118aba770a76 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:49.557024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 965/1916] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:49.913715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:49.918296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:50.027966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f8785-7209-4be6-b129-e9e30acbeec5 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:50.037085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:50.037901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:50.038311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:50.039372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] PATH_INFO: `/v3/users/658aa7be1abc481abcbc4758729cb632` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:50.042752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=658aa7be1abc481abcbc4758729cb632)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:50.046526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:50.133110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658aa7be1abc481abcbc4758729cb632'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.147033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658aa7be1abc481abcbc4758729cb632'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.147734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658aa7be1abc481abcbc4758729cb632'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.157011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658aa7be1abc481abcbc4758729cb632'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.172087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658aa7be1abc481abcbc4758729cb632'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.178788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 952/1917] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:49 2022] DELETE /identity/v3/users/658aa7be1abc481abcbc4758729cb632 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:50.183636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:50.183918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:50.184188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:50.204544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:50.205786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:50.231802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:50.274686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 966/1918] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:50.286382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:50.286543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:50.322674 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:50.350877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29085323-ea56-4863-b7b5-6afe25a9fe7b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:50.354540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:50.355814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:50.355814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:50.355814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:50.366582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:50.368039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:50.378947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 953/1919] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:50.748665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:50.756743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:50.773246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a84495-75f8-4293-a329-39c6419f5f66 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:50.788442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:50.789098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:50.789373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:50.789640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] PATH_INFO: `/v3/projects/6b65889b78f44286bc020469e6df0aa3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:50.790965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b65889b78f44286bc020469e6df0aa3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:50.793144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:50.860719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b65889b78f44286bc020469e6df0aa3', 'request_id': 'req-cc25b5ff-ab15-41b1-8123-fabd4706de29'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.867902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b65889b78f44286bc020469e6df0aa3', 'request_id': 'req-cc25b5ff-ab15-41b1-8123-fabd4706de29'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.876230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b65889b78f44286bc020469e6df0aa3', 'request_id': 'req-cc25b5ff-ab15-41b1-8123-fabd4706de29'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.895766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] The token cache is being invalidate because project 6b65889b78f44286bc020469e6df0aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:50.896058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.896680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:50.898534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 967/1920] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:50 2022] DELETE /identity/v3/projects/6b65889b78f44286bc020469e6df0aa3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:50.902318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:50.922057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39af0f-a60b-4440-a93d-ef22fd4d62d1 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:50.992913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:50.993669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:50.994014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:50.994898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] PATH_INFO: `/v3/users/017e90e71db4419e9a2d3972bce8c61a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:50.996335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=017e90e71db4419e9a2d3972bce8c61a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:50.998423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:51.055936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017e90e71db4419e9a2d3972bce8c61a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.071303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017e90e71db4419e9a2d3972bce8c61a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.072272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017e90e71db4419e9a2d3972bce8c61a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.083683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017e90e71db4419e9a2d3972bce8c61a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.101852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cb3ad3a3-1c67-41bc-98ef-3e8fa8e4c788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017e90e71db4419e9a2d3972bce8c61a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.109567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 954/1921] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:50 2022] DELETE /identity/v3/users/017e90e71db4419e9a2d3972bce8c61a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:51.667687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:51.669134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:51.689888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25b5ff-ab15-41b1-8123-fabd4706de29 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:51.773675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:51.774356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:51.774629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:51.774901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] PATH_INFO: `/v3/projects/9ac7a519fa9b40d7bbf0c64e22cfdcd4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:51.776029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac7a519fa9b40d7bbf0c64e22cfdcd4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:51.778073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:51.835585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac7a519fa9b40d7bbf0c64e22cfdcd4', 'request_id': 'req-128572a6-0c5d-40f8-976a-e2eb0bf7b801'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.840669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:51.841856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac7a519fa9b40d7bbf0c64e22cfdcd4', 'request_id': 'req-128572a6-0c5d-40f8-976a-e2eb0bf7b801'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.850834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac7a519fa9b40d7bbf0c64e22cfdcd4', 'request_id': 'req-128572a6-0c5d-40f8-976a-e2eb0bf7b801'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.865854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] The token cache is being invalidate because project 9ac7a519fa9b40d7bbf0c64e22cfdcd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:51.866179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.866855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-128572a6-0c5d-40f8-976a-e2eb0bf7b801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:51.868472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 968/1922] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:51 2022] DELETE /identity/v3/projects/9ac7a519fa9b40d7bbf0c64e22cfdcd4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:51.873375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946dca-e328-46d8-93ee-842ff5a1862c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:51.873653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946dca-e328-46d8-93ee-842ff5a1862c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:51.873920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2946dca-e328-46d8-93ee-842ff5a1862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:51.894605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a2946dca-e328-46d8-93ee-842ff5a1862c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:51.895841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a2946dca-e328-46d8-93ee-842ff5a1862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:51.944733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:51.960282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 955/1923] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:51.968352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee30b-643b-484d-836b-6cefe4ccfc8a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:51.968956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee30b-643b-484d-836b-6cefe4ccfc8a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:51.969229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ee30b-643b-484d-836b-6cefe4ccfc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:51.989826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-315ee30b-643b-484d-836b-6cefe4ccfc8a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:51.991120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-315ee30b-643b-484d-836b-6cefe4ccfc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:51.999214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 969/1924] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:52.004605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2946dca-e328-46d8-93ee-842ff5a1862c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.016394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2946dca-e328-46d8-93ee-842ff5a1862c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.021385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.021876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.022428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.022620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.023220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:52.023713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.025985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.044176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 956/1925] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:58:52.045105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee30b-643b-484d-836b-6cefe4ccfc8a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.056711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ee30b-643b-484d-836b-6cefe4ccfc8a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.062686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.063387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.063757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.064095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.064796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.066942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.101212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 970/1926] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:52 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:52.105208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.117700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186743a-752b-4a28-ad2e-131c8848868e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.184944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.185559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.185864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.186168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.186804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.189456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.215230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 957/1927] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:52 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:52.219273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.244562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9b694-bd79-4dcc-9e35-1ef8e469fad5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.254878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.255556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.255964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.256412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.257068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.258860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.282713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 971/1928] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:52.286904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.314487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26d187-b5f5-4b18-ab8f-65dc153fd45a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.319526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bc911-4122-4666-8efc-72b36158b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.320233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bc911-4122-4666-8efc-72b36158b5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.320582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bc911-4122-4666-8efc-72b36158b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.320924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bc911-4122-4666-8efc-72b36158b5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.321665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bc911-4122-4666-8efc-72b36158b5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.323589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bc911-4122-4666-8efc-72b36158b5ce admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.336475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 958/1929] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:52.340704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.355043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a030f82-5649-4edf-8219-38244587d07b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.362567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.363344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.363644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.364022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] PATH_INFO: `/v3/projects/ebf7c0fdf33a4bbeb62cc470a644477f/users/96ab65d87af349b3a5f044805622f6da/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.381813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf7c0fdf33a4bbeb62cc470a644477f, user_id=96ab65d87af349b3a5f044805622f6da, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.384651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.403767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 972/1930] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:52 2022] PUT /identity/v3/projects/ebf7c0fdf33a4bbeb62cc470a644477f/users/96ab65d87af349b3a5f044805622f6da/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:52.416250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bf63-1f43-4f78-b91e-8cea439d8985 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.416250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bf63-1f43-4f78-b91e-8cea439d8985 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.416740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bf63-1f43-4f78-b91e-8cea439d8985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.455143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8962bf63-1f43-4f78-b91e-8cea439d8985 None None] MFA Rules not processed for user `96ab65d87af349b3a5f044805622f6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:52.456337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8962bf63-1f43-4f78-b91e-8cea439d8985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:52.526337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 959/1931] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:52.537807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.539494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:52.597816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879524fc-452c-43dd-8be5-e1f15079aa16 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.601645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26aa6f-805f-43c2-b8e1-481f26b6b896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.602349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aa6f-805f-43c2-b8e1-481f26b6b896 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.602623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aa6f-805f-43c2-b8e1-481f26b6b896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.602891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26aa6f-805f-43c2-b8e1-481f26b6b896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.612784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26aa6f-805f-43c2-b8e1-481f26b6b896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.614258 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26aa6f-805f-43c2-b8e1-481f26b6b896 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.623093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 973/1932] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:52.644870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962bf63-1f43-4f78-b91e-8cea439d8985 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.713444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:52.728139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962bf63-1f43-4f78-b91e-8cea439d8985 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:52.734530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:52.735293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.736129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.736129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] PATH_INFO: `/v3/users/96ab65d87af349b3a5f044805622f6da` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.737144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ab65d87af349b3a5f044805622f6da)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:52.739213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:52.816052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ab65d87af349b3a5f044805622f6da'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:52.847337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ab65d87af349b3a5f044805622f6da'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:52.847337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ab65d87af349b3a5f044805622f6da'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:52.856707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ab65d87af349b3a5f044805622f6da'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:52.885191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ab65d87af349b3a5f044805622f6da'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:52.893601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 960/1933] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:52 2022] DELETE /identity/v3/users/96ab65d87af349b3a5f044805622f6da => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:52.898270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:52.898747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:52.898939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:52.919585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:52.920912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:52.986481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 974/1934] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:52.997050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:52.998586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.058254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f80a7-514a-423c-ae47-93aafe6c68d3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:53.061894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:53.062643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.062925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.063196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.072013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:53.073459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:53.087745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 961/1935] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:53.425378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:53.426825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.440641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4705c6a-2575-45c7-9d48-b98a49b17ee3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:53.445641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:53.446380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.446631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.446887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] PATH_INFO: `/v3/projects/ebf7c0fdf33a4bbeb62cc470a644477f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.448558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf7c0fdf33a4bbeb62cc470a644477f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:53.450822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:53.479129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:53.524392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf7c0fdf33a4bbeb62cc470a644477f', 'request_id': 'req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.534551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf7c0fdf33a4bbeb62cc470a644477f', 'request_id': 'req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.541055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:53.542671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.545811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf7c0fdf33a4bbeb62cc470a644477f', 'request_id': 'req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.558948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a434-678e-44f4-8fcd-cab52b137603 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:53.564633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] The token cache is being invalidate because project ebf7c0fdf33a4bbeb62cc470a644477f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:53.564920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.566501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e104b2bc-d7e6-4f3a-bf41-0c960ca63e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.571051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 975/1936] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:53 2022] DELETE /identity/v3/projects/ebf7c0fdf33a4bbeb62cc470a644477f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:53.575642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ec32-a34a-41f2-a998-e01cac1dfa1a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.575921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ec32-a34a-41f2-a998-e01cac1dfa1a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.576189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ec32-a34a-41f2-a998-e01cac1dfa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.597368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b4e2ec32-a34a-41f2-a998-e01cac1dfa1a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:53.598602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b4e2ec32-a34a-41f2-a998-e01cac1dfa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.628987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:53.629535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.629723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.629990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] PATH_INFO: `/v3/users/2b0c5ab3933046a481bbfe83e3289eb6` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.631151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0c5ab3933046a481bbfe83e3289eb6)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:53.633102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:53.653184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:53.664892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 976/1937] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:53.674294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cc27-45ea-489f-bc77-688e70321562 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.674544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cc27-45ea-489f-bc77-688e70321562 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.674844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127cc27-45ea-489f-bc77-688e70321562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.694863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0c5ab3933046a481bbfe83e3289eb6'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.696943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b127cc27-45ea-489f-bc77-688e70321562 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:53.698298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b127cc27-45ea-489f-bc77-688e70321562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.705739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0c5ab3933046a481bbfe83e3289eb6'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.706487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0c5ab3933046a481bbfe83e3289eb6'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.709261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 977/1938] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:53.713401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127cc27-45ea-489f-bc77-688e70321562 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:53.715204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0c5ab3933046a481bbfe83e3289eb6'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.724140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127cc27-45ea-489f-bc77-688e70321562 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:53.728290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-327847b7-87a3-4fe7-ac74-3043191ee9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0c5ab3933046a481bbfe83e3289eb6'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:53.728668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:53.729251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.729529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.729825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.730516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:53.730959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:53.732539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:53.740941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 962/1939] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:53 2022] DELETE /identity/v3/users/2b0c5ab3933046a481bbfe83e3289eb6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:53.745564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.745704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 978/1940] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:58:53.745853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.746159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.750522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:53.753272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.766524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8899f8e-7845-42f6-8d66-bc9d44e9d38c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:53.767373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:53.768547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.828115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:53.828728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.829004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.829273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.829903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:53.830990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 963/1941] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:53.832081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:53.840830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:53.842174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:53.866356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 979/1942] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:53.867696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:53.884361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:53.921361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ebbba-5497-4b5d-8067-a1c58188c2e0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:53.942270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e1520-3a6b-4478-8cbd-de4e2c2d5505 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:53.948610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:53.948857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.949085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.949356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.949981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:53.952489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:53.979007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:53.984492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 980/1943] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:53 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:53.985488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:53.985860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:53.986366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:53.986874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:53.987372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:53.999771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf590d-a3cc-4c93-acee-1c6c26b57409 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.011502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.012120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.012397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.012696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.013414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.015633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.023019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.024490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.030195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 981/1944] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:54.033420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.043522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 964/1945] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:54.044638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ab745-5a8a-42da-96ea-57b814a35a62 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.049766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd7813-f44d-46c4-bd07-127ba355e3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.050505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd7813-f44d-46c4-bd07-127ba355e3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.050846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd7813-f44d-46c4-bd07-127ba355e3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.051178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd7813-f44d-46c4-bd07-127ba355e3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.052146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd7813-f44d-46c4-bd07-127ba355e3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.053561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd7813-f44d-46c4-bd07-127ba355e3e4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.066221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 982/1946] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:54.070065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.080524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7877c4-6b9a-49be-823e-107413c1a07d service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.085915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.086695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.087052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.087393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] PATH_INFO: `/v3/projects/3706d1fca86b440fa660d52fd482a52d/users/8e6e1d6e37954d61bbb3aa0282fcc38f/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.111696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3706d1fca86b440fa660d52fd482a52d, user_id=8e6e1d6e37954d61bbb3aa0282fcc38f, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.115446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.142307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 965/1947] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:54 2022] PUT /identity/v3/projects/3706d1fca86b440fa660d52fd482a52d/users/8e6e1d6e37954d61bbb3aa0282fcc38f/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:54.143651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be418e2-d651-4670-b1c3-1e53edf2d65d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.143934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be418e2-d651-4670-b1c3-1e53edf2d65d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.144205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be418e2-d651-4670-b1c3-1e53edf2d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.175246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2be418e2-d651-4670-b1c3-1e53edf2d65d None None] MFA Rules not processed for user `8e6e1d6e37954d61bbb3aa0282fcc38f`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:54.176584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2be418e2-d651-4670-b1c3-1e53edf2d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:54.256723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 983/1948] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:54.261282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.332278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01df69-8247-4848-a124-321fb89ef00c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.337932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.339076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.339358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.339631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.340265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.342201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.377781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 966/1949] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:54 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:54.382914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be418e2-d651-4670-b1c3-1e53edf2d65d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.395900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be418e2-d651-4670-b1c3-1e53edf2d65d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.425787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.427683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:54.470065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.470695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.471025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.471300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.472224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.474058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.497377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:54.504201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 984/1950] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:54 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:54.507669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.511772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f8aea-7023-45d8-b67f-7dfba20232a4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.517669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.518369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.518644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.518912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] PATH_INFO: `/v3/projects/408e8a117df84f0ebf1dde13030e8e87` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.520020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=408e8a117df84f0ebf1dde13030e8e87)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.520783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981dc6-3e48-4d41-8bd0-c34c3ef37866 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.521941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.526182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.526791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.527071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.527341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.527977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.529695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.544843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 985/1951] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:54.549119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.560128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5596-a6e0-43a9-883d-a784a9f4681e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.572972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408e8a117df84f0ebf1dde13030e8e87', 'request_id': 'req-b50ad013-091b-4349-84ad-b144bf853e5f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.576727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:54.582406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408e8a117df84f0ebf1dde13030e8e87', 'request_id': 'req-b50ad013-091b-4349-84ad-b144bf853e5f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.589920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408e8a117df84f0ebf1dde13030e8e87', 'request_id': 'req-b50ad013-091b-4349-84ad-b144bf853e5f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.601529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] The token cache is being invalidate because project 408e8a117df84f0ebf1dde13030e8e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:54.601816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.602494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.603988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 967/1952] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:54 2022] DELETE /identity/v3/projects/408e8a117df84f0ebf1dde13030e8e87 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:54.607866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.609783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:54.621900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.622573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.622854 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.623124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.623763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.626044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.635787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 986/1953] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:54.639936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.641760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:54.654055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69b35a-8871-429a-b45c-aed398df2b09 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.660848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86953274-b5ea-4902-9f6d-f8dd24e661a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.661500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953274-b5ea-4902-9f6d-f8dd24e661a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.661782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953274-b5ea-4902-9f6d-f8dd24e661a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.662055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86953274-b5ea-4902-9f6d-f8dd24e661a5 admin admin] PATH_INFO: `/v3/projects/207620ec08ad4cbb8040a672a6a4c2d3/users/40139add2d3d4610b5331cdf5ba9933c/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.679226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86953274-b5ea-4902-9f6d-f8dd24e661a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=207620ec08ad4cbb8040a672a6a4c2d3, user_id=40139add2d3d4610b5331cdf5ba9933c, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.681204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ad013-091b-4349-84ad-b144bf853e5f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.682179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86953274-b5ea-4902-9f6d-f8dd24e661a5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.689970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.691302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.692629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.694249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] PATH_INFO: `/v3/users/86a0046e08d7446787d37e19bd14162b` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.695894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a0046e08d7446787d37e19bd14162b)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.698136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 987/1954] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:54 2022] PUT /identity/v3/projects/207620ec08ad4cbb8040a672a6a4c2d3/users/40139add2d3d4610b5331cdf5ba9933c/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:54.699402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.710788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2c7f2-5ada-4a12-b85e-4244ddf8ace3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.711349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2c7f2-5ada-4a12-b85e-4244ddf8ace3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.711766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2c7f2-5ada-4a12-b85e-4244ddf8ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.744890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9fd2c7f2-5ada-4a12-b85e-4244ddf8ace3 None None] MFA Rules not processed for user `40139add2d3d4610b5331cdf5ba9933c`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:54.746219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9fd2c7f2-5ada-4a12-b85e-4244ddf8ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:54.755466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a0046e08d7446787d37e19bd14162b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.763603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a0046e08d7446787d37e19bd14162b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.764404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a0046e08d7446787d37e19bd14162b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.773056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a0046e08d7446787d37e19bd14162b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.787881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a0046e08d7446787d37e19bd14162b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:54.795353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 968/1955] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:54 2022] DELETE /identity/v3/users/86a0046e08d7446787d37e19bd14162b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:54.824681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 988/1956] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:54.829852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:54.831318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:54.901685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca719a6-e67f-4068-823c-6d83bc77ca10 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:54.907018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:54.907626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:54.907898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:54.908165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:54.908846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:54.910817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:54.917946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:54.967962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 969/1957] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:54 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:54.972250 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2c7f2-5ada-4a12-b85e-4244ddf8ace3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.029922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:55.043811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2c7f2-5ada-4a12-b85e-4244ddf8ace3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.101485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.102275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.102556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.103016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.103658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.106337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.106817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.108399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:55.130874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 989/1958] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:54 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:55.136114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.145882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89858b3-2567-4a30-99fb-917d45a025df admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.147850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873f617-f9bd-4cdf-9f3c-e1c65edc7aff admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.151772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.152483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.152777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.152897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.153188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] PATH_INFO: `/v3/projects/7b8a8c79998a4e27b83eb1249c7aaf8a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.153373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.153827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.154047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.154730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.154824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8a8c79998a4e27b83eb1249c7aaf8a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.157508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.157660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.172394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 990/1959] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:55.174129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.193110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32022-5008-44cf-83e7-cbc5dc4d4be4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.200942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.202138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.202945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.203428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] PATH_INFO: `/v3/projects/234971fd4a3f40f58ae87f46469b3301/users/56e2512d78ce40b6917a136df46da3fa/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.216875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8a8c79998a4e27b83eb1249c7aaf8a', 'request_id': 'req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:55.221862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=234971fd4a3f40f58ae87f46469b3301, user_id=56e2512d78ce40b6917a136df46da3fa, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.225020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.228375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8a8c79998a4e27b83eb1249c7aaf8a', 'request_id': 'req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:55.238009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8a8c79998a4e27b83eb1249c7aaf8a', 'request_id': 'req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:55.242975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 991/1960] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:55 2022] PUT /identity/v3/projects/234971fd4a3f40f58ae87f46469b3301/users/56e2512d78ce40b6917a136df46da3fa/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:55.247584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.252347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] The token cache is being invalidate because project 7b8a8c79998a4e27b83eb1249c7aaf8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:55.253106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:55.254045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2d3dbb5-c950-407e-b105-183a4dcb4b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:55.256138 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 970/1961] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:55 2022] DELETE /identity/v3/projects/7b8a8c79998a4e27b83eb1249c7aaf8a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:55.261218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0720e1a-cb68-46d5-94bf-e45e1d332867 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.261681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0720e1a-cb68-46d5-94bf-e45e1d332867 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.261982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0720e1a-cb68-46d5-94bf-e45e1d332867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.287055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e0720e1a-cb68-46d5-94bf-e45e1d332867 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:55.288291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e0720e1a-cb68-46d5-94bf-e45e1d332867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:55.342848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855112f-f2fd-4548-94ba-ce0501edb76d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.350576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.351199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.351481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.351755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.352403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.355642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.366564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 971/1962] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:55.369519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 992/1963] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:55.375377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97eb2-b93f-423e-a024-9da629096861 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.375530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.376165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97eb2-b93f-423e-a024-9da629096861 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.377456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d97eb2-b93f-423e-a024-9da629096861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.382969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:55.410429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef59c06-45d0-47a4-97e1-908ea76ad2f9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.416859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.417956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.418552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.419050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] PATH_INFO: `/v3/projects/234971fd4a3f40f58ae87f46469b3301/users/56e2512d78ce40b6917a136df46da3fa/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.420118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a5d97eb2-b93f-423e-a024-9da629096861 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:55.421494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a5d97eb2-b93f-423e-a024-9da629096861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:55.421797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234971fd4a3f40f58ae87f46469b3301, user_id=56e2512d78ce40b6917a136df46da3fa, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.426198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.440768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 993/1964] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:55 2022] PUT /identity/v3/projects/234971fd4a3f40f58ae87f46469b3301/users/56e2512d78ce40b6917a136df46da3fa/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:55.450206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 972/1965] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:55.450324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.455756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.456228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.456501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.491525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] MFA Rules not processed for user `56e2512d78ce40b6917a136df46da3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:55.493076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:55.512276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:55.545734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26bc422-fceb-4d6c-84ed-0a42c241d227 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.551787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.552604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.553043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.553466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.554339 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:55.554810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.556920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.561243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:55.575969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 994/1966] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:58:55.580810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.589896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 973/1967] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:55.598591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e50a2e-a8a0-45bb-91e5-354893fbb05b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.604669 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.605335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.605620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.605894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.606184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.606630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.610636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.615047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:55.647247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 995/1968] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:55 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:55.651900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.705973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b9e54-7ed2-4a01-b06a-38dfb236d96d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.754348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b9688-07fb-45a9-b834-e2474d23732a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.763273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.764136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.764429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.765274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.767434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.773798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.774847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.775607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.776161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.778469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:55.779360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.810709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 996/1969] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:55 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:55.814849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.828063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262c4e-d82b-44a4-9b25-6e3f841c229c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.833612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.834188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.834502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.834793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.835744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.837474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.850165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 997/1970] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:55.853730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.863257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.864519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f796d3c-e3f2-48e6-891b-52f7ad308f80 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.864828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.869609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4915dd-3cab-4163-b04a-d9debe4886f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.870628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4915dd-3cab-4163-b04a-d9debe4886f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.871072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4915dd-3cab-4163-b04a-d9debe4886f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.871456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4915dd-3cab-4163-b04a-d9debe4886f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.872235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4915dd-3cab-4163-b04a-d9debe4886f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.874492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4915dd-3cab-4163-b04a-d9debe4886f3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.877680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 974/1971] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:55.893152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 998/1972] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:55.893586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:55.904834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78074c3-fb58-45b9-9008-e4974b695b31 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:55.910824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:55.911603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.911948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.912293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] PATH_INFO: `/v3/projects/10684bc602984e738b9388f3a004b026/users/9a50e87c5c9f40168637b7b5a2de213e/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:55.941886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10684bc602984e738b9388f3a004b026, user_id=9a50e87c5c9f40168637b7b5a2de213e, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:55.945585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:55.963335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 975/1973] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:55 2022] PUT /identity/v3/projects/10684bc602984e738b9388f3a004b026/users/9a50e87c5c9f40168637b7b5a2de213e/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:55.974868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114973-4555-4f7d-922b-dddd71c73e5f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:55.975398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114973-4555-4f7d-922b-dddd71c73e5f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:55.975500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114973-4555-4f7d-922b-dddd71c73e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.013772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9f114973-4555-4f7d-922b-dddd71c73e5f None None] MFA Rules not processed for user `9a50e87c5c9f40168637b7b5a2de213e`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:56.015952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9f114973-4555-4f7d-922b-dddd71c73e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:56.105516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 999/1974] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:56.111135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:56.157046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:56.193713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb322d-c9b1-44dd-877d-7e658d61a534 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:56.199369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:56.200014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.200348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.200618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.201306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:56.204078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:56.247377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 976/1975] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:56 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:56.248188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f114973-4555-4f7d-922b-dddd71c73e5f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:56.257172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:56.263814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f114973-4555-4f7d-922b-dddd71c73e5f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:56.345191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:56.345807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.346261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.346533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.347170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:56.349085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:56.371385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1000/1976] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:56 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:56.376196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:56.386462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1acb9d-a848-4d06-af2c-fbc95cf465b6 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:56.392605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:56.393212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.393489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.393761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.394431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:56.396007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:56.410881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 977/1977] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:56.411803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:56.422039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a71d0-b6f3-4973-98d5-d56d2a9c414a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:56.426770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:56.427456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.427758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.428018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] PATH_INFO: `/v3/projects/a53629ed761e4abebd2df2afa0df5151/users/95fab29f16034ec4aa7d69eebe165edd/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.453638 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53629ed761e4abebd2df2afa0df5151, user_id=95fab29f16034ec4aa7d69eebe165edd, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:56.459970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:56.478559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1001/1978] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:56 2022] PUT /identity/v3/projects/a53629ed761e4abebd2df2afa0df5151/users/95fab29f16034ec4aa7d69eebe165edd/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:56.482889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:56.500450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6318c-7d63-4b95-9000-910b523cf07d admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:56.605328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964903a-99ac-473c-b9ea-d912860cb61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:56.605947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964903a-99ac-473c-b9ea-d912860cb61e admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.606258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964903a-99ac-473c-b9ea-d912860cb61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.606532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964903a-99ac-473c-b9ea-d912860cb61e admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.607201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964903a-99ac-473c-b9ea-d912860cb61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:56.609580 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964903a-99ac-473c-b9ea-d912860cb61e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:56.622197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 978/1979] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:56.627414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:56.643346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47481b8-ce3e-42df-b6e1-8ecc7c03799a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:56.648027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:56.648677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.648951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.649218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] PATH_INFO: `/v3/projects/a53629ed761e4abebd2df2afa0df5151/users/95fab29f16034ec4aa7d69eebe165edd/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.651161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53629ed761e4abebd2df2afa0df5151, user_id=95fab29f16034ec4aa7d69eebe165edd, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:56.653786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:56.664348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1002/1980] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:56 2022] PUT /identity/v3/projects/a53629ed761e4abebd2df2afa0df5151/users/95fab29f16034ec4aa7d69eebe165edd/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:56.676084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f03d-35af-4607-a688-e58f6267384d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.676369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f03d-35af-4607-a688-e58f6267384d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.676659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f03d-35af-4607-a688-e58f6267384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.716338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c214f03d-35af-4607-a688-e58f6267384d None None] MFA Rules not processed for user `95fab29f16034ec4aa7d69eebe165edd`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:56.717566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c214f03d-35af-4607-a688-e58f6267384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:56.789536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 979/1981] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:56.801343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:56.862920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502d08f-f081-4998-b01d-031aafb58fa9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:56.868313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a16aad-f72e-49d2-b9ba-27bb685ff274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:56.868931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a16aad-f72e-49d2-b9ba-27bb685ff274 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:56.869212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a16aad-f72e-49d2-b9ba-27bb685ff274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:56.869484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a16aad-f72e-49d2-b9ba-27bb685ff274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:56.880453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a16aad-f72e-49d2-b9ba-27bb685ff274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:56.881829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a16aad-f72e-49d2-b9ba-27bb685ff274 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:56.892806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1003/1982] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:56.964962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f03d-35af-4607-a688-e58f6267384d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:57.012566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:57.064947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f03d-35af-4607-a688-e58f6267384d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:57.072646 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:57.073531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:57.073924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:57.074443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] PATH_INFO: `/v3/users/9a50e87c5c9f40168637b7b5a2de213e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:57.077073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a50e87c5c9f40168637b7b5a2de213e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:57.081314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:57.148371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a50e87c5c9f40168637b7b5a2de213e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.157234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a50e87c5c9f40168637b7b5a2de213e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.158198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a50e87c5c9f40168637b7b5a2de213e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.169330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a50e87c5c9f40168637b7b5a2de213e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.187227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a50e87c5c9f40168637b7b5a2de213e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.194569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 980/1983] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:56 2022] DELETE /identity/v3/users/9a50e87c5c9f40168637b7b5a2de213e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:57.198673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:57.199138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:57.199337 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:57.233155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:57.234927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:57.303190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:57.311293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1004/1984] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:58:57.322888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:57.324619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:57.397938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7833467-802d-490e-b1bd-0fe49af58f96 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:57.401793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:57.402457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:57.402786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:57.403118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:57.412581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:57.414077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:57.425594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 981/1985] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:57.822288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:57.823754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:57.836361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a33b33-635d-4a6d-b71d-762fcac332e3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:57.840901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:57.841534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:57.841813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:57.842103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] PATH_INFO: `/v3/projects/10684bc602984e738b9388f3a004b026` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:57.845188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10684bc602984e738b9388f3a004b026)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:57.847245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:57.893252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10684bc602984e738b9388f3a004b026', 'request_id': 'req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.899263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10684bc602984e738b9388f3a004b026', 'request_id': 'req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.906467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10684bc602984e738b9388f3a004b026', 'request_id': 'req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.919912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] The token cache is being invalidate because project 10684bc602984e738b9388f3a004b026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:57.920288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.921616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:57.923599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1005/1986] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:57 2022] DELETE /identity/v3/projects/10684bc602984e738b9388f3a004b026 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:57.927618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:57.938785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a2551-568b-4d61-9511-250a8df2891b service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:57.996429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:58.012650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:58.013297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:58.014284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:58.014394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] PATH_INFO: `/v3/users/95fab29f16034ec4aa7d69eebe165edd` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:58.016539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fab29f16034ec4aa7d69eebe165edd)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:58.018623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:58.078808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fab29f16034ec4aa7d69eebe165edd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:58.086943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fab29f16034ec4aa7d69eebe165edd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:58.087625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fab29f16034ec4aa7d69eebe165edd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:58.095630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fab29f16034ec4aa7d69eebe165edd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:58.108322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fab29f16034ec4aa7d69eebe165edd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:58.115346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 982/1987] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:58:57 2022] DELETE /identity/v3/users/95fab29f16034ec4aa7d69eebe165edd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:58.659193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:58.660750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:58.779409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01e8be-a3c1-4ce1-a6c1-c6e2939ba236 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:58.850170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95827865-1a02-49fa-bfe3-b4b87b87fe5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:58.850794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827865-1a02-49fa-bfe3-b4b87b87fe5d service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:58.851071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827865-1a02-49fa-bfe3-b4b87b87fe5d service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:58.851341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827865-1a02-49fa-bfe3-b4b87b87fe5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:58.853263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-95827865-1a02-49fa-bfe3-b4b87b87fe5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:58.921736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:58.923636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95827865-1a02-49fa-bfe3-b4b87b87fe5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:58.926476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95827865-1a02-49fa-bfe3-b4b87b87fe5d service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:58.950544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1006/1988] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:58:59.050341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.052013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:59.195782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8d140-d4ba-453a-8418-9b579491d8f4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.202178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.203298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.204753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.205266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] PATH_INFO: `/v3/projects/a53629ed761e4abebd2df2afa0df5151` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.207270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53629ed761e4abebd2df2afa0df5151)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.210243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.306396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53629ed761e4abebd2df2afa0df5151', 'request_id': 'req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:59.323538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53629ed761e4abebd2df2afa0df5151', 'request_id': 'req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:59.334391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53629ed761e4abebd2df2afa0df5151', 'request_id': 'req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:59.350182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] The token cache is being invalidate because project a53629ed761e4abebd2df2afa0df5151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:58:59.350722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:59.351819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6ca65c05-ff26-47b9-a68a-c0986a8cd60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:58:59.353869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 983/1989] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:58:59 2022] DELETE /identity/v3/projects/a53629ed761e4abebd2df2afa0df5151 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:58:59.358751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd4f0-4d05-455c-b6a4-2a2f79a90525 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.359124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd4f0-4d05-455c-b6a4-2a2f79a90525 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.359208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd4f0-4d05-455c-b6a4-2a2f79a90525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.401743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-15ebd4f0-4d05-455c-b6a4-2a2f79a90525 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:59.403466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-15ebd4f0-4d05-455c-b6a4-2a2f79a90525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:59.501133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1007/1990] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:59.509602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6878c-8666-4bb3-ab9c-9b43fe5fdaa8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.509999 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6878c-8666-4bb3-ab9c-9b43fe5fdaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.510202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6878c-8666-4bb3-ab9c-9b43fe5fdaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.524278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:58:59.541881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9fe6878c-8666-4bb3-ab9c-9b43fe5fdaa8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:59.544019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9fe6878c-8666-4bb3-ab9c-9b43fe5fdaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:59.552792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 984/1991] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:58:59.557862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd4f0-4d05-455c-b6a4-2a2f79a90525 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.571504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd4f0-4d05-455c-b6a4-2a2f79a90525 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.578645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.580050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.580341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.580612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.581270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:58:59.581880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.583527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.599204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1008/1992] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:58:59.601211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6878c-8666-4bb3-ab9c-9b43fe5fdaa8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.610929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6878c-8666-4bb3-ab9c-9b43fe5fdaa8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.615899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.616540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.616815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.617088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.617712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.619675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.652444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 985/1993] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:58:59 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:58:59.658714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.672830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ccf1f-b52d-4326-8930-a1c885205e37 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.739919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.740742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.740918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.741202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.741849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.743744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.762506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.764228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:59.771790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1009/1994] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:58:59 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:58:59.773046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.785896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8d49e-1120-4055-acaf-89c96f3c577e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.792656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.793262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.793545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.793821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.794618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.796258 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.807748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1010/1995] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:58:59.811542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.821541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a4d69-95d2-42bd-8110-55e83b80cfd9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.826989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e435dd1-19a0-4b5e-992b-fd6b917cc1ce admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.829710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.830358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.830645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.830910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.831809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.832116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.832749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.833090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.833406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.833508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.835846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:59.847656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1011/1996] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:58:59.849078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:58:59.861436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb0f00-47f4-4b1e-b7c0-da4a3d1c9104 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:58:59.866441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271e6b9-89d1-40e1-9c81-3ff15697fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:58:59.867097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271e6b9-89d1-40e1-9c81-3ff15697fbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.867659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271e6b9-89d1-40e1-9c81-3ff15697fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.867659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271e6b9-89d1-40e1-9c81-3ff15697fbb8 admin admin] PATH_INFO: `/v3/projects/669f07ca5ed648f6a92d5d66d5ae29f9/users/4c3e1ed61253458089f4ec31295c3294/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.882726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271e6b9-89d1-40e1-9c81-3ff15697fbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669f07ca5ed648f6a92d5d66d5ae29f9, user_id=4c3e1ed61253458089f4ec31295c3294, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.885393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271e6b9-89d1-40e1-9c81-3ff15697fbb8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.901349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1012/1997] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:58:59 2022] PUT /identity/v3/projects/669f07ca5ed648f6a92d5d66d5ae29f9/users/4c3e1ed61253458089f4ec31295c3294/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:58:59.906868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0141-5739-40f4-a634-62cbf7f679e3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:58:59.907610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0141-5739-40f4-a634-62cbf7f679e3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:58:59.907610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0141-5739-40f4-a634-62cbf7f679e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:58:59.910053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:58:59.911798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:58:59.923889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 986/1998] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:58:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:58:59.927471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d94d0141-5739-40f4-a634-62cbf7f679e3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:58:59.929037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d94d0141-5739-40f4-a634-62cbf7f679e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:58:59.951581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:00.006295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1013/1999] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:00.018888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:00.019059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:00.084298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215603a-fffc-4c12-9431-60a7c98ced1e service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:00.126748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:00.142134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:00.142761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:00.143040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:00.143311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:00.153441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:00.156066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:00.168442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 987/2000] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:01.018381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b890cb-3b80-470d-9949-2f31a265175b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:01.018914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b890cb-3b80-470d-9949-2f31a265175b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:01.018914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b890cb-3b80-470d-9949-2f31a265175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:01.046926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a7b890cb-3b80-470d-9949-2f31a265175b None None] MFA Rules not processed for user `4c3e1ed61253458089f4ec31295c3294`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:01.048125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a7b890cb-3b80-470d-9949-2f31a265175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:01.131237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1014/2001] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:01.143186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:01.145190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:01.211339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7276d-b5d1-41f3-8126-d8c9493401e0 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:01.215467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:01.216088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:01.216368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:01.216641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:01.225713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:01.227202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:01.250421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 988/2002] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:02.705187 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319cd7b-19fb-4a63-8a1e-44fb6e088c2a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:02.706068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319cd7b-19fb-4a63-8a1e-44fb6e088c2a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:02.706376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319cd7b-19fb-4a63-8a1e-44fb6e088c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:02.727470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2319cd7b-19fb-4a63-8a1e-44fb6e088c2a None None] MFA Rules not processed for user `4c3e1ed61253458089f4ec31295c3294`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:02.728910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2319cd7b-19fb-4a63-8a1e-44fb6e088c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:02.750241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1015/2003] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:03.004808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:03.006879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:03.034959 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8842521-2839-4eb0-98e6-0543f270fcc5 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:03.051208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:03.052501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:03.052501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:03.052855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] PATH_INFO: `/v3/users/b4cf2f8a405045db9e0dc18a675ed55c` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:03.055268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cf2f8a405045db9e0dc18a675ed55c)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:03.059658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:03.180637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cf2f8a405045db9e0dc18a675ed55c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:03.190996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cf2f8a405045db9e0dc18a675ed55c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:03.192200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cf2f8a405045db9e0dc18a675ed55c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:03.216057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cf2f8a405045db9e0dc18a675ed55c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:03.241645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cf2f8a405045db9e0dc18a675ed55c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:03.259695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 989/2004] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:03 2022] DELETE /identity/v3/users/b4cf2f8a405045db9e0dc18a675ed55c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:03.261492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:03.262072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:03.262524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:03.307239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:03.308501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:03.438172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1016/2005] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:03.445969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:03.447448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:03.541905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eaf31-43cf-4de2-8c5a-521268aa4cc1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:03.545917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe2e5-6ded-4b72-a7c4-d25f4a1e4139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:03.546617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe2e5-6ded-4b72-a7c4-d25f4a1e4139 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:03.546774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe2e5-6ded-4b72-a7c4-d25f4a1e4139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:03.547032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe2e5-6ded-4b72-a7c4-d25f4a1e4139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:03.556801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe2e5-6ded-4b72-a7c4-d25f4a1e4139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:03.558259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe2e5-6ded-4b72-a7c4-d25f4a1e4139 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:03.570200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:03.577610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 990/2006] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:04.159086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:04.160509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:04.173529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a551cf-8cd8-40d8-b305-8fc99d4d8919 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:04.181042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:04.181242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:04.181525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:04.181799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] PATH_INFO: `/v3/users/8e6e1d6e37954d61bbb3aa0282fcc38f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:04.183036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6e1d6e37954d61bbb3aa0282fcc38f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:04.184954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:04.230613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:04.234587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6e1d6e37954d61bbb3aa0282fcc38f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.243684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6e1d6e37954d61bbb3aa0282fcc38f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.257648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6e1d6e37954d61bbb3aa0282fcc38f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.258400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6e1d6e37954d61bbb3aa0282fcc38f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.266322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6e1d6e37954d61bbb3aa0282fcc38f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.273155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1017/2007] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:04 2022] DELETE /identity/v3/users/8e6e1d6e37954d61bbb3aa0282fcc38f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:04.277850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:04.278340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:04.278428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:04.300096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:04.301326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:04.369187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 991/2008] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:04.382410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:04.384718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:04.455919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd704-cb71-45c6-b677-801d82f28285 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:04.460433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:04.461015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:04.461296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:04.461569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:04.474133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:04.475558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:04.490467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1018/2009] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:04.697624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:04.699772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:04.723021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c709155-e39d-4506-a419-170855d9ed23 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:04.729844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:04.730752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:04.731303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:04.731723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] PATH_INFO: `/v3/projects/3ecfd1006b564227b568f61bd98005b3` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:04.733083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecfd1006b564227b568f61bd98005b3)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:04.735219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:04.830082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecfd1006b564227b568f61bd98005b3', 'request_id': 'req-bf874aea-42ec-432e-b56a-c4768521a770'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.849220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecfd1006b564227b568f61bd98005b3', 'request_id': 'req-bf874aea-42ec-432e-b56a-c4768521a770'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.867484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecfd1006b564227b568f61bd98005b3', 'request_id': 'req-bf874aea-42ec-432e-b56a-c4768521a770'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.869351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:04.871191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:04.898137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] The token cache is being invalidate because project 3ecfd1006b564227b568f61bd98005b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:04.898137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.898137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bf874aea-42ec-432e-b56a-c4768521a770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:04.898459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5411c60-baf6-4c4f-800f-47760d39f94f service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:04.898532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 992/2010] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:04 2022] DELETE /identity/v3/projects/3ecfd1006b564227b568f61bd98005b3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:04.903030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab223f-3e0b-4879-b5d6-54720c9d28fd None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:04.903030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab223f-3e0b-4879-b5d6-54720c9d28fd None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:04.903030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab223f-3e0b-4879-b5d6-54720c9d28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:04.933776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-11ab223f-3e0b-4879-b5d6-54720c9d28fd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:04.935387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-11ab223f-3e0b-4879-b5d6-54720c9d28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:05.009144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.009791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.010078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.010607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] PATH_INFO: `/v3/projects/3706d1fca86b440fa660d52fd482a52d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.011786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3706d1fca86b440fa660d52fd482a52d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.013717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.023468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 993/2011] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:05.031980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd7bc-21b5-4e36-b7d8-ba64c5ef1cda None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.032268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd7bc-21b5-4e36-b7d8-ba64c5ef1cda None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.032635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd7bc-21b5-4e36-b7d8-ba64c5ef1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.055537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a6cfd7bc-21b5-4e36-b7d8-ba64c5ef1cda None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:05.058183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a6cfd7bc-21b5-4e36-b7d8-ba64c5ef1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:05.081336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3706d1fca86b440fa660d52fd482a52d', 'request_id': 'req-b17349f4-145f-4c76-be04-a3e2a6875755'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.086016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:05.088602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3706d1fca86b440fa660d52fd482a52d', 'request_id': 'req-b17349f4-145f-4c76-be04-a3e2a6875755'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.097774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3706d1fca86b440fa660d52fd482a52d', 'request_id': 'req-b17349f4-145f-4c76-be04-a3e2a6875755'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.102592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:05.132447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] The token cache is being invalidate because project 3706d1fca86b440fa660d52fd482a52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:05.132893 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.134871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.137727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1019/2012] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:04 2022] DELETE /identity/v3/projects/3706d1fca86b440fa660d52fd482a52d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:05.141971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.143768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:05.153953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 994/2013] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:05.159499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd7bc-21b5-4e36-b7d8-ba64c5ef1cda None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.166042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17349f4-145f-4c76-be04-a3e2a6875755 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.173756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.174290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd7bc-21b5-4e36-b7d8-ba64c5ef1cda None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.174497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.174769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.175212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] PATH_INFO: `/v3/users/40139add2d3d4610b5331cdf5ba9933c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.176963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40139add2d3d4610b5331cdf5ba9933c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.179727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.190167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.190923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.191234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.191482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.192255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:05.192563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.194214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.234044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 995/2014] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:59:05.237744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.259649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa08a-24ee-472b-8e3a-de6860ff37aa admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.259791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40139add2d3d4610b5331cdf5ba9933c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.274778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40139add2d3d4610b5331cdf5ba9933c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.283279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.283909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.284193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.284461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.285091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.287199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.294429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40139add2d3d4610b5331cdf5ba9933c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.295430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40139add2d3d4610b5331cdf5ba9933c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.313127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40139add2d3d4610b5331cdf5ba9933c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:05.323652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1020/2015] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:05 2022] DELETE /identity/v3/users/40139add2d3d4610b5331cdf5ba9933c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:05.340924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 996/2016] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:05 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:05.343744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.345212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:05.429963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152b69-0509-49bb-874d-edaacb762bc1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.493724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.494380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.494667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.494944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.495591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.497522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.522605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1021/2017] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:05 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:05.526302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.536849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df55f4d-5f35-4991-95cc-76e8d927fe62 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.541888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.542537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.542812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.543078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.543719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.545442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.557324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 997/2018] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:05.562552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.568206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:05.575762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56911f88-cc63-4eb1-b847-87cfb8e4e374 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.583491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ecc22-aa6a-42b4-835b-c4e6fa45d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.584191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ecc22-aa6a-42b4-835b-c4e6fa45d141 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.584538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ecc22-aa6a-42b4-835b-c4e6fa45d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.584878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ecc22-aa6a-42b4-835b-c4e6fa45d141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.585591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ecc22-aa6a-42b4-835b-c4e6fa45d141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.587334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ecc22-aa6a-42b4-835b-c4e6fa45d141 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.598213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1022/2019] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:05.602558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.613785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45e1cb-2f54-4e56-9144-13d4bfc94c0a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.618536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.619193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.619479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.619759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] PATH_INFO: `/v3/projects/0e725c4b0ca141fd9c5a79270d066b19/users/ec349e70c11a4fc49a2a1d065ddbd58c/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.635679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e725c4b0ca141fd9c5a79270d066b19, user_id=ec349e70c11a4fc49a2a1d065ddbd58c, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.638364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.652095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 998/2020] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:05 2022] PUT /identity/v3/projects/0e725c4b0ca141fd9c5a79270d066b19/users/ec349e70c11a4fc49a2a1d065ddbd58c/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:05.663144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.663431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.663702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.702869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] MFA Rules not processed for user `ec349e70c11a4fc49a2a1d065ddbd58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:05.704171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:05.792607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1023/2021] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:05.805266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.806362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:05.871450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81468e-697a-4132-9746-514cc6a34f71 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:05.876651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:05.877172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:05.880261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:05.880261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:05.881809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:05.884006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:05.926384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:05.927839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:05.954194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 999/2022] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:06.036297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa8a3a-d2d6-4d07-9274-aed5208703ba None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:06.044407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:06.045967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:06.046188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:06.046423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] PATH_INFO: `/v3/projects/207620ec08ad4cbb8040a672a6a4c2d3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:06.047771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207620ec08ad4cbb8040a672a6a4c2d3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:06.049908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:06.149987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207620ec08ad4cbb8040a672a6a4c2d3', 'request_id': 'req-af6418f1-6b25-469c-8eb6-f1ec10d6d624'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.157579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207620ec08ad4cbb8040a672a6a4c2d3', 'request_id': 'req-af6418f1-6b25-469c-8eb6-f1ec10d6d624'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.166571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207620ec08ad4cbb8040a672a6a4c2d3', 'request_id': 'req-af6418f1-6b25-469c-8eb6-f1ec10d6d624'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.184045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] The token cache is being invalidate because project 207620ec08ad4cbb8040a672a6a4c2d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:06.184344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.184993 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.187177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1024/2023] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:05 2022] DELETE /identity/v3/projects/207620ec08ad4cbb8040a672a6a4c2d3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:06.191672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:06.204450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a578082-7755-48f5-bdb0-ae1ee74aa7c9 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:06.359698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:06.377872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:06.378560 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:06.378839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:06.379105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] PATH_INFO: `/v3/users/56e2512d78ce40b6917a136df46da3fa` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:06.393604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e2512d78ce40b6917a136df46da3fa)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:06.401134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:06.550722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e2512d78ce40b6917a136df46da3fa'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.563500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e2512d78ce40b6917a136df46da3fa'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.564275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e2512d78ce40b6917a136df46da3fa'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.573552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e2512d78ce40b6917a136df46da3fa'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.591382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1dfab165-95f5-4545-b905-659f19079133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e2512d78ce40b6917a136df46da3fa'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:06.600352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1000/2024] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:06 2022] DELETE /identity/v3/users/56e2512d78ce40b6917a136df46da3fa => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:07.038639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:07.040976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:07.062374 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6418f1-6b25-469c-8eb6-f1ec10d6d624 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:07.078880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:07.225395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:07.226054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.226360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.226641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] PATH_INFO: `/v3/projects/234971fd4a3f40f58ae87f46469b3301` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.228036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=234971fd4a3f40f58ae87f46469b3301)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:07.233926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:07.333235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234971fd4a3f40f58ae87f46469b3301', 'request_id': 'req-3076fbb3-65eb-4889-8254-e02aa91199b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:07.340380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234971fd4a3f40f58ae87f46469b3301', 'request_id': 'req-3076fbb3-65eb-4889-8254-e02aa91199b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:07.350295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234971fd4a3f40f58ae87f46469b3301', 'request_id': 'req-3076fbb3-65eb-4889-8254-e02aa91199b0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:07.369045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] The token cache is being invalidate because project 234971fd4a3f40f58ae87f46469b3301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:07.369655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:07.370789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-3076fbb3-65eb-4889-8254-e02aa91199b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:07.376441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1025/2025] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:07 2022] DELETE /identity/v3/projects/234971fd4a3f40f58ae87f46469b3301 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:07.377723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772b1-2b85-441d-96fb-19a5ccff84a3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.378279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772b1-2b85-441d-96fb-19a5ccff84a3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.378365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772b1-2b85-441d-96fb-19a5ccff84a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.416727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-73a772b1-2b85-441d-96fb-19a5ccff84a3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:07.420559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-73a772b1-2b85-441d-96fb-19a5ccff84a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:07.519337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1001/2026] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:07.527494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c020-be58-4c4b-9697-09e4b71e9db7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.527779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c020-be58-4c4b-9697-09e4b71e9db7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.528219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459c020-be58-4c4b-9697-09e4b71e9db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.566960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4459c020-be58-4c4b-9697-09e4b71e9db7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:07.568207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4459c020-be58-4c4b-9697-09e4b71e9db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:07.577002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1026/2027] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:07.581772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a772b1-2b85-441d-96fb-19a5ccff84a3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:07.595356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a772b1-2b85-441d-96fb-19a5ccff84a3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:07.602034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:07.602755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.603040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.603327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.603982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:07.604302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:07.605899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:07.631607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459c020-be58-4c4b-9697-09e4b71e9db7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:07.634312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1002/2028] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:59:07.651599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459c020-be58-4c4b-9697-09e4b71e9db7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:07.665015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:07.665634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.665911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.666215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.666858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:07.668760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:07.716673 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1027/2029] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:07 2022] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:07.721031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:07.740436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ebeb-56ea-4aeb-85b5-76fc1def1bda admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:07.829599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:07.830310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.830599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.830863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.831765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:07.833690 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:07.846399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:07.867770 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:07.877516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1003/2030] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:07 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:07.879675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a360fe-2687-408d-ab5f-04c6aaf10d6a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:07.884544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:07.885387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.885387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.885637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.886310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:07.888059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:07.901390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1028/2031] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:59:07.906005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:07.915779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa565164-e134-4a11-9557-a9211ed9f6a1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:07.921115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543e352-8da7-44c0-a3f7-0e3097ac40d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:07.921841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543e352-8da7-44c0-a3f7-0e3097ac40d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.922226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543e352-8da7-44c0-a3f7-0e3097ac40d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.922419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543e352-8da7-44c0-a3f7-0e3097ac40d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.923050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543e352-8da7-44c0-a3f7-0e3097ac40d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:07.924628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543e352-8da7-44c0-a3f7-0e3097ac40d0 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:07.935641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1004/2032] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:59:07.940176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:07.950066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445a0bb-8b01-43ee-a446-26938536c22a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:07.954965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:07.955599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:07.955875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:07.956144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] PATH_INFO: `/v3/projects/5b92fd55e2a54c81a579b8b348d9e081/users/b96a4f1a6cc64778962f4c7bcd3b05fc/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:07.971113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b92fd55e2a54c81a579b8b348d9e081, user_id=b96a4f1a6cc64778962f4c7bcd3b05fc, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:07.973730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:07.988281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1029/2033] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:07 2022] PUT /identity/v3/projects/5b92fd55e2a54c81a579b8b348d9e081/users/b96a4f1a6cc64778962f4c7bcd3b05fc/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:08.066408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:08.066696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:08.067417 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:08.105018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] MFA Rules not processed for user `b96a4f1a6cc64778962f4c7bcd3b05fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:08.106419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:08.190113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1005/2034] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:08.209818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:08.211917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:08.268460 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:08.290176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894df3dc-e964-41cf-9b4e-1dc3a60b8847 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:08.294795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58945f90-970c-45a2-b9df-e622a94221a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3849cb5e321d48c88f0e19121ec7e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:08.295410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945f90-970c-45a2-b9df-e622a94221a0 service glance] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:08.295776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945f90-970c-45a2-b9df-e622a94221a0 service glance] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:08.296112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945f90-970c-45a2-b9df-e622a94221a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:08.305158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58945f90-970c-45a2-b9df-e622a94221a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:08.306800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58945f90-970c-45a2-b9df-e622a94221a0 service glance] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:08.317227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1030/2035] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:18.186116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:18.315503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=9 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:20.396250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:20.397765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:20.464434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca4dbc-0e08-4823-a1f7-01c6f9f8ed11 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:20.469433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:20.470073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:20.470374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:20.470649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] PATH_INFO: `/v3/users/ec349e70c11a4fc49a2a1d065ddbd58c` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:20.471762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec349e70c11a4fc49a2a1d065ddbd58c)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:20.474015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:20.520821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec349e70c11a4fc49a2a1d065ddbd58c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:20.529213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec349e70c11a4fc49a2a1d065ddbd58c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:20.529979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec349e70c11a4fc49a2a1d065ddbd58c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:20.537216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec349e70c11a4fc49a2a1d065ddbd58c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:20.549600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec349e70c11a4fc49a2a1d065ddbd58c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:20.555540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1006/2036] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:20 2022] DELETE /identity/v3/users/ec349e70c11a4fc49a2a1d065ddbd58c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:20.559763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:20.560207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:20.560297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:20.579681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:20.580878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:20.639310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1031/2037] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:20.649056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:20.650547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:20.712177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348ad1b-d625-447d-80ee-ab0651a73cab admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:20.715815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44d658-2515-4175-a70a-3be3417c10df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:20.716409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44d658-2515-4175-a70a-3be3417c10df service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:20.716683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44d658-2515-4175-a70a-3be3417c10df service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:20.716946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44d658-2515-4175-a70a-3be3417c10df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:20.725875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44d658-2515-4175-a70a-3be3417c10df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:20.727327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44d658-2515-4175-a70a-3be3417c10df service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:20.737078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1007/2038] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:21.120413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.122211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:21.135255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a550ff3-e84b-4274-afde-6268670db8da None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.139865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.140489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.140766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.141035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] PATH_INFO: `/v3/projects/0e725c4b0ca141fd9c5a79270d066b19` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.142199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e725c4b0ca141fd9c5a79270d066b19)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.145351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.197488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e725c4b0ca141fd9c5a79270d066b19', 'request_id': 'req-beaf2400-1dc9-4f79-90fb-0b9af6f52988'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:21.203313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e725c4b0ca141fd9c5a79270d066b19', 'request_id': 'req-beaf2400-1dc9-4f79-90fb-0b9af6f52988'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:21.209686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e725c4b0ca141fd9c5a79270d066b19', 'request_id': 'req-beaf2400-1dc9-4f79-90fb-0b9af6f52988'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:21.224194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] The token cache is being invalidate because project 0e725c4b0ca141fd9c5a79270d066b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:21.224831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:21.225709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-beaf2400-1dc9-4f79-90fb-0b9af6f52988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:21.230548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1032/2039] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:21 2022] DELETE /identity/v3/projects/0e725c4b0ca141fd9c5a79270d066b19 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:21.232103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aacddf-799c-40cc-bc21-110390b81a7b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.232387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aacddf-799c-40cc-bc21-110390b81a7b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.232660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aacddf-799c-40cc-bc21-110390b81a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.255113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a5aacddf-799c-40cc-bc21-110390b81a7b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:21.257302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a5aacddf-799c-40cc-bc21-110390b81a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:21.281812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:21.343829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1008/2040] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:21.352938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda3815-2a2d-4354-8777-6a58c89c9729 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.353127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda3815-2a2d-4354-8777-6a58c89c9729 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.353451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda3815-2a2d-4354-8777-6a58c89c9729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.387175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4dda3815-2a2d-4354-8777-6a58c89c9729 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:21.388419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4dda3815-2a2d-4354-8777-6a58c89c9729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:21.397981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1033/2041] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:21.402282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aacddf-799c-40cc-bc21-110390b81a7b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.413203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aacddf-799c-40cc-bc21-110390b81a7b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.437182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.437814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.438142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.438399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.439059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:21.439392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.441005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.453128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1009/2042] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:59:21.457921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda3815-2a2d-4354-8777-6a58c89c9729 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.467064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda3815-2a2d-4354-8777-6a58c89c9729 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.471792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.472388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.472664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.472930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.473570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.475611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.504095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1034/2043] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:21 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:21.508377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.518735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a901-2f16-4015-9c5f-a8129c989117 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.581211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.582291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.582572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.582843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.583529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.585934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.615155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1010/2044] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:21 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:21.616259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.628458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd10a3-87e4-45d6-8f75-376d8643c3af admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.633652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.634304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.634587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.634860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.635529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.637170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.648362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1035/2045] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:21.652579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.663786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32835cb7-b6c3-4345-88c7-95a59737b477 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.669111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e77ce4-3f4e-42f6-9eb9-5b567a312b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.669812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e77ce4-3f4e-42f6-9eb9-5b567a312b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.670046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e77ce4-3f4e-42f6-9eb9-5b567a312b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.671108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e77ce4-3f4e-42f6-9eb9-5b567a312b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.671950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e77ce4-3f4e-42f6-9eb9-5b567a312b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.674731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e77ce4-3f4e-42f6-9eb9-5b567a312b9b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.688820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1011/2046] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:21.697996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.710132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db796d14-e2dc-4986-879a-a12d62771bc6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.714967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.715880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.716137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.716425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] PATH_INFO: `/v3/projects/795b7529b74a4c11b190367476bcd67f/users/3ddfee721b534e93b422e424c079dcd1/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.733454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] RBAC: Authorizing `identity:create_grant(project_id=795b7529b74a4c11b190367476bcd67f, user_id=3ddfee721b534e93b422e424c079dcd1, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.736135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.750749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1036/2047] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:21 2022] PUT /identity/v3/projects/795b7529b74a4c11b190367476bcd67f/users/3ddfee721b534e93b422e424c079dcd1/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:21.762012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b900-a8c1-4c50-9a7a-1b11d5cccaa3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.762336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b900-a8c1-4c50-9a7a-1b11d5cccaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.762613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b900-a8c1-4c50-9a7a-1b11d5cccaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.792335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-acb3b900-a8c1-4c50-9a7a-1b11d5cccaa3 None None] MFA Rules not processed for user `3ddfee721b534e93b422e424c079dcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:21.793716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-acb3b900-a8c1-4c50-9a7a-1b11d5cccaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:21.861557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1012/2048] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:21.866315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.886921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:21.928484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1a7c8-92dd-4463-861b-85cc1266002c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:21.933144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:21.933743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:21.934038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:21.934320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:21.934948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:21.937451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:21.965475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1037/2049] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:21 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:21.969547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b900-a8c1-4c50-9a7a-1b11d5cccaa3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:21.982242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b900-a8c1-4c50-9a7a-1b11d5cccaa3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.000400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:22.066232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.067046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.067423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.067794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.068529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.070759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.097426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1013/2050] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:21 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:22.101691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.114746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d68da0-eaef-48a7-90eb-4400b7d9c93f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.120613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.121301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.121837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.122107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.122846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.125420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.136674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1038/2051] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:22.140917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.150924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be456bd-1ca7-41bd-b8a1-3e1bc9b73c6a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.155666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685307e-6fad-4db1-b307-960534bb17ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.156267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685307e-6fad-4db1-b307-960534bb17ec admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.156543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685307e-6fad-4db1-b307-960534bb17ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.156808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685307e-6fad-4db1-b307-960534bb17ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.157442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685307e-6fad-4db1-b307-960534bb17ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.159049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685307e-6fad-4db1-b307-960534bb17ec admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.173087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1014/2052] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:22.174386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.184705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b8804-8593-467d-b816-87e60ce75641 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.189928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.190619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.190898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.191170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] PATH_INFO: `/v3/projects/ca8755daf06f408793fba46a7847c9f8/users/b4ca553a94514197a7fbd5fbe26e2e85/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.206562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8755daf06f408793fba46a7847c9f8, user_id=b4ca553a94514197a7fbd5fbe26e2e85, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.209216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.222849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1039/2053] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:22 2022] PUT /identity/v3/projects/ca8755daf06f408793fba46a7847c9f8/users/b4ca553a94514197a7fbd5fbe26e2e85/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:22.234344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57428660-3471-4058-b7f8-aabddea3c3f2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.234633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57428660-3471-4058-b7f8-aabddea3c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.234910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57428660-3471-4058-b7f8-aabddea3c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.263656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-57428660-3471-4058-b7f8-aabddea3c3f2 None None] MFA Rules not processed for user `b4ca553a94514197a7fbd5fbe26e2e85`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:22.265095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-57428660-3471-4058-b7f8-aabddea3c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:22.334973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1015/2054] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:22.343225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.419508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1488cfb-e681-4284-bfbf-43b221ad6d0a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.425531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.426534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.426816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.427084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.427713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.431079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.488006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1040/2055] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:22.491604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57428660-3471-4058-b7f8-aabddea3c3f2 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.505032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57428660-3471-4058-b7f8-aabddea3c3f2 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.574756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.575386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.576239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.576921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.577730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.579767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.610142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1016/2056] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:22 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:22.615911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.637175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c038219-845c-4174-b88d-9628b0c4082a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.646278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.647120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.647549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.648036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.648971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.650971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.675593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1041/2057] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:22.682406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.693632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6afd1d-658e-4133-80c3-7d7978c57b27 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.701155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.703323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.703515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.703803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] PATH_INFO: `/v3/projects/76864f5a8ade4059a3b29120d4a82118/users/842f9447b9a446b2a7c699fe92721e93/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.718541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:22.725114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76864f5a8ade4059a3b29120d4a82118, user_id=842f9447b9a446b2a7c699fe92721e93, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.729185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.753409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1017/2058] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:22 2022] PUT /identity/v3/projects/76864f5a8ade4059a3b29120d4a82118/users/842f9447b9a446b2a7c699fe92721e93/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:22.757210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.768175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74c5f-ab89-48e8-9081-e02a890e07a1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.810427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:22.828618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5242a-48af-4617-aca3-c8af419a555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.829212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5242a-48af-4617-aca3-c8af419a555c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.829493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5242a-48af-4617-aca3-c8af419a555c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.829765 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5242a-48af-4617-aca3-c8af419a555c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.830436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5242a-48af-4617-aca3-c8af419a555c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.832327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5242a-48af-4617-aca3-c8af419a555c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.843866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1042/2059] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:22.847725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:22.859539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc879-f443-46d7-8132-889215990375 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:22.864215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:22.864872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.865148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.865956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] PATH_INFO: `/v3/projects/76864f5a8ade4059a3b29120d4a82118/users/842f9447b9a446b2a7c699fe92721e93/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.867354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76864f5a8ade4059a3b29120d4a82118, user_id=842f9447b9a446b2a7c699fe92721e93, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:22.870010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:22.883078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1018/2060] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:22 2022] PUT /identity/v3/projects/76864f5a8ade4059a3b29120d4a82118/users/842f9447b9a446b2a7c699fe92721e93/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:22.892775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:22.893119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:22.893412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:22.923266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] MFA Rules not processed for user `842f9447b9a446b2a7c699fe92721e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:22.924476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:23.017295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1043/2061] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:23.025541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:23.027970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:23.099482 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957364-c5e2-488f-b4a6-004dacaf9103 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:23.103995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcbc39-0c40-4154-b211-fffe2c9ecded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:23.104666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcbc39-0c40-4154-b211-fffe2c9ecded service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:23.105044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcbc39-0c40-4154-b211-fffe2c9ecded service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:23.106973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcbc39-0c40-4154-b211-fffe2c9ecded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:23.199958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcbc39-0c40-4154-b211-fffe2c9ecded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:23.201618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcbc39-0c40-4154-b211-fffe2c9ecded service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:23.212488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1019/2062] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:24.918792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:24.921059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:24.944568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a49f4-e532-4385-8a26-44c0260a8ccd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:24.956570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:24.957083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:24.957360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:24.957630 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.008922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa893aa-2b7c-458d-9bd3-53b1f5a36e7a None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.009486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa893aa-2b7c-458d-9bd3-53b1f5a36e7a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.009778 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa893aa-2b7c-458d-9bd3-53b1f5a36e7a None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.012156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1020/2063] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:59:25.030760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:25.032708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:25.043659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1044/2064] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:59:25.046746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262394-ef05-4614-9cc9-5fea304c1d35 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.052396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262394-ef05-4614-9cc9-5fea304c1d35 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.052697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262394-ef05-4614-9cc9-5fea304c1d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.101759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:25.107139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:25.126071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-cb262394-ef05-4614-9cc9-5fea304c1d35 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:25.131692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-cb262394-ef05-4614-9cc9-5fea304c1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:25.235520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ec2fa-6a36-4b72-af8d-095e9768d664 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:25.241620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:25.242539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.242853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.243203 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] PATH_INFO: `/v3/users/23dccda2753a4956a7f0c936682ce100` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.244682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23dccda2753a4956a7f0c936682ce100)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:25.248649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:25.260657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1021/2065] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:25.265920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:25.283679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a0de-68a2-4029-9a89-6ef837193c6b None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.283964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a0de-68a2-4029-9a89-6ef837193c6b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.284241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1a0de-68a2-4029-9a89-6ef837193c6b None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.286028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1022/2066] 10.222.0.52 () {54 vars in 961 bytes} [Fri Sep 9 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 14:59:25.292931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53194f1-fe43-4bf1-b09d-5a4bf2aea351 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.293211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53194f1-fe43-4bf1-b09d-5a4bf2aea351 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.293486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53194f1-fe43-4bf1-b09d-5a4bf2aea351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.325794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d53194f1-fe43-4bf1-b09d-5a4bf2aea351 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:25.327649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d53194f1-fe43-4bf1-b09d-5a4bf2aea351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:25.343593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1023/2067] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Sep 9 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:25.351337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53194f1-fe43-4bf1-b09d-5a4bf2aea351 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:25.362288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53194f1-fe43-4bf1-b09d-5a4bf2aea351 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:25.369977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:25.370904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.371024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.371297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.379548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23dccda2753a4956a7f0c936682ce100'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.382724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:25.385473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:25.387668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23dccda2753a4956a7f0c936682ce100'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.401099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1024/2068] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:59:25.406487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23dccda2753a4956a7f0c936682ce100'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.407257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23dccda2753a4956a7f0c936682ce100'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.416723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23dccda2753a4956a7f0c936682ce100'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.425922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1045/2069] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:25 2022] DELETE /identity/v3/users/23dccda2753a4956a7f0c936682ce100 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:25.634125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:25.647862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858484d-2347-4a9d-83af-9c1071dd8a4c service placement] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:25.656650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:25.718602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:25.719539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.719919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.720287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] PATH_INFO: `/v3/projects/0a516458980c4e7eba3c8e4eaa0e21f8` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.721929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a516458980c4e7eba3c8e4eaa0e21f8)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:25.723876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:25.775789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a516458980c4e7eba3c8e4eaa0e21f8', 'request_id': 'req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.785098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a516458980c4e7eba3c8e4eaa0e21f8', 'request_id': 'req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.788624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:25.790044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:25.792065 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a516458980c4e7eba3c8e4eaa0e21f8', 'request_id': 'req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.802511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] The token cache is being invalidate because project 0a516458980c4e7eba3c8e4eaa0e21f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:25.802792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.803431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d8343f31-43eb-41f5-b8a3-a4a5f0b32697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:25.805131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1025/2070] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:25 2022] DELETE /identity/v3/projects/0a516458980c4e7eba3c8e4eaa0e21f8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:25.809692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb960f-239c-448f-b572-9f95cc149f35 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.809969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb960f-239c-448f-b572-9f95cc149f35 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.810277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb960f-239c-448f-b572-9f95cc149f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.830355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-78cb960f-239c-448f-b572-9f95cc149f35 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:25.831911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-78cb960f-239c-448f-b572-9f95cc149f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:25.854708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79529a3-589e-4ec3-bf7a-76cdc8908e66 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:25.903857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1026/2071] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:25.912146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626016-efdf-4149-aa8b-c8346dca699c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.912657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626016-efdf-4149-aa8b-c8346dca699c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.912928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626016-efdf-4149-aa8b-c8346dca699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.919880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:25.920791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.920929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.921181 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.923784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:25.940790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8b626016-efdf-4149-aa8b-c8346dca699c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:25.942000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8b626016-efdf-4149-aa8b-c8346dca699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:25.950163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1027/2072] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:25.954918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b626016-efdf-4149-aa8b-c8346dca699c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:25.965030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b626016-efdf-4149-aa8b-c8346dca699c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:25.971219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:25.971838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:25.972137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:25.972412 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:25.973900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:25.974618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:25.976231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:25.979561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:25.989516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1028/2073] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:59:25.993734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:25.997865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:25.999562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:26.003966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ff7d4-bb13-4483-8205-2e4a7b51fbd1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:26.009647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:26.010310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:26.010575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:26.010847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:26.011491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:26.013444 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:26.018520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1046/2074] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:59:26.037752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:26.049525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1029/2075] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:25 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:26.050644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:26.062729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561145a1-c522-4a15-aaf0-9b48d6443d8b service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:26.131351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:26.132270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:26.132482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:26.133838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:26.134650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:26.136817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:26.164434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1047/2076] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:26 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:26.165783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:26.179765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719a0e4-9b21-4e36-8aac-c361d597209d admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:26.186361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:26.186979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:26.187261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:26.187533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:26.188182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:26.189823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:26.200348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1030/2077] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:26.205060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:26.215505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc370d1-0453-4c88-bda3-72d3e266f34c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:26.220991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041e83f-5f5e-4187-989c-becdcedfca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:26.221584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041e83f-5f5e-4187-989c-becdcedfca0c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:26.221944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041e83f-5f5e-4187-989c-becdcedfca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:26.222265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041e83f-5f5e-4187-989c-becdcedfca0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:26.223417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041e83f-5f5e-4187-989c-becdcedfca0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:26.224579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041e83f-5f5e-4187-989c-becdcedfca0c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:26.238183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1048/2078] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:26.240183 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:26.251170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e3e7b-af0a-4da6-b8c0-40fd2ed0c255 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:26.255908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:26.256592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:26.256873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:26.257150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] PATH_INFO: `/v3/projects/fba7b5e105544060b90c4febd2ba08b5/users/9182c7bbbae941378c5822826adc7251/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:26.272953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba7b5e105544060b90c4febd2ba08b5, user_id=9182c7bbbae941378c5822826adc7251, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:26.275636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:26.288845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1031/2079] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:26 2022] PUT /identity/v3/projects/fba7b5e105544060b90c4febd2ba08b5/users/9182c7bbbae941378c5822826adc7251/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:26.295789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03125-9886-463c-8b30-7a0d844adb9b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:26.296153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03125-9886-463c-8b30-7a0d844adb9b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:26.296490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e03125-9886-463c-8b30-7a0d844adb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:26.317347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-38e03125-9886-463c-8b30-7a0d844adb9b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:26.318561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-38e03125-9886-463c-8b30-7a0d844adb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:26.380713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1049/2080] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:26.390688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:26.392471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:26.458912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf54199-df2b-452b-8436-a0653debde9e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:26.463300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:26.463991 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:26.464337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:26.464679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:26.475982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:26.477682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:26.488191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1032/2081] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:27.870830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36790dab-7e2f-492b-8c3d-b76773453107 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:27.871382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36790dab-7e2f-492b-8c3d-b76773453107 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:27.871382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36790dab-7e2f-492b-8c3d-b76773453107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:27.919352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-36790dab-7e2f-492b-8c3d-b76773453107 None None] MFA Rules not processed for user `9182c7bbbae941378c5822826adc7251`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:27.921880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-36790dab-7e2f-492b-8c3d-b76773453107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:28.028586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:28.038525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1050/2082] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:28.039567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:28.049467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e8e19-2191-48e5-9036-7f5f69012b7d service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:28.055006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:28.055611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:28.055921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:28.056198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:28.056831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:28.058782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:28.101416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1033/2083] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:28 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:28.102953 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36790dab-7e2f-492b-8c3d-b76773453107 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:28.114740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36790dab-7e2f-492b-8c3d-b76773453107 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:28.179190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:28.179802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:28.180087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:28.180360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:28.180992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:28.182941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:28.206808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1051/2084] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:28 2022] POST /identity/v3/users => generated 309 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:28.211105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:28.221957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6b1af-373b-48a8-a006-a30a01b6699a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:28.226881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:28.227536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:28.227894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:28.228081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:28.228756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:28.230389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:28.243224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1034/2085] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:28.247399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:28.257557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ff8a2-f16e-4c77-9399-b80c292a5123 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:28.262079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:28.262748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:28.263030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:28.263300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] PATH_INFO: `/v3/projects/3576685d6af944eda3e1b1cf5f35a8d1/users/d457cf27ebed47e3bfd40ce55990547d/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:28.278445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3576685d6af944eda3e1b1cf5f35a8d1, user_id=d457cf27ebed47e3bfd40ce55990547d, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:28.281947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:28.293922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1052/2086] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:28 2022] PUT /identity/v3/projects/3576685d6af944eda3e1b1cf5f35a8d1/users/d457cf27ebed47e3bfd40ce55990547d/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:28.297801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:28.307956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da95e-1f06-4636-8250-8f8703f82a98 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:28.366549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78689d7-2a61-4d9b-aca0-0f24098d1524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:28.367152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78689d7-2a61-4d9b-aca0-0f24098d1524 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:28.367430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78689d7-2a61-4d9b-aca0-0f24098d1524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:28.367700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78689d7-2a61-4d9b-aca0-0f24098d1524 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:28.368331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78689d7-2a61-4d9b-aca0-0f24098d1524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:28.369913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78689d7-2a61-4d9b-aca0-0f24098d1524 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:28.380554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1035/2087] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:28.384730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:28.396220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067df78d-2510-4f29-b4cf-f2d6f233a08c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:28.400743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5af7d2-0101-4087-b027-990475eda00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:28.401378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af7d2-0101-4087-b027-990475eda00b admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:28.401654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af7d2-0101-4087-b027-990475eda00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:28.401920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5af7d2-0101-4087-b027-990475eda00b admin admin] PATH_INFO: `/v3/projects/3576685d6af944eda3e1b1cf5f35a8d1/users/d457cf27ebed47e3bfd40ce55990547d/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:28.403802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5af7d2-0101-4087-b027-990475eda00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3576685d6af944eda3e1b1cf5f35a8d1, user_id=d457cf27ebed47e3bfd40ce55990547d, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:28.407087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5af7d2-0101-4087-b027-990475eda00b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:28.418649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1053/2088] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:28 2022] PUT /identity/v3/projects/3576685d6af944eda3e1b1cf5f35a8d1/users/d457cf27ebed47e3bfd40ce55990547d/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:29.058547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee6b11-535d-4caa-8813-96224c345a06 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:29.060186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee6b11-535d-4caa-8813-96224c345a06 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:29.060729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee6b11-535d-4caa-8813-96224c345a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:29.087555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-53ee6b11-535d-4caa-8813-96224c345a06 None None] MFA Rules not processed for user `4c3e1ed61253458089f4ec31295c3294`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:29.088982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-53ee6b11-535d-4caa-8813-96224c345a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:29.126793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:29.169031 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ba31-15b7-4d82-b0f7-da4adbb33373 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:29.169581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ba31-15b7-4d82-b0f7-da4adbb33373 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:29.169581 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7ba31-15b7-4d82-b0f7-da4adbb33373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:29.185407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1036/2089] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:29.208400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a1c7ba31-15b7-4d82-b0f7-da4adbb33373 None None] MFA Rules not processed for user `d457cf27ebed47e3bfd40ce55990547d`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:29.210213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a1c7ba31-15b7-4d82-b0f7-da4adbb33373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:29.299210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1054/2090] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:29.848788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b7d-2f86-4205-b57f-f11ee28cb173 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:29.849069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b7d-2f86-4205-b57f-f11ee28cb173 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:29.850277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b7d-2f86-4205-b57f-f11ee28cb173 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:29.852054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1037/2091] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 14:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 14:59:29.880814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:29.881103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:29.881383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:29.919304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] MFA Rules not processed for user `ef370b70e8194df9a52c26e21c375730`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:29.921029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:29.966859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:30.013236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1055/2092] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:30.024995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b7d-2f86-4205-b57f-f11ee28cb173 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:30.026896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-53015b7d-2f86-4205-b57f-f11ee28cb173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:30.053238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b7d-2f86-4205-b57f-f11ee28cb173 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:30.060302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d487b-4359-40a7-a07d-8dd732c4575b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:30.062758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d487b-4359-40a7-a07d-8dd732c4575b service placement] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:30.063226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d487b-4359-40a7-a07d-8dd732c4575b service placement] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:30.063662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d487b-4359-40a7-a07d-8dd732c4575b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:30.082632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d487b-4359-40a7-a07d-8dd732c4575b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:30.085130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d487b-4359-40a7-a07d-8dd732c4575b service placement] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:30.100797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:30.102965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:30.111974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1038/2093] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:30.216011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c7373-48fb-4aab-a10a-946f5ef646e9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:30.225823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:30.227024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:30.227603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:30.228146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] PATH_INFO: `/v3/users/3ddfee721b534e93b422e424c079dcd1` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:30.229774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddfee721b534e93b422e424c079dcd1)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:30.232052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:30.290313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddfee721b534e93b422e424c079dcd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.303855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddfee721b534e93b422e424c079dcd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.320422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddfee721b534e93b422e424c079dcd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.321167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddfee721b534e93b422e424c079dcd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.331467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddfee721b534e93b422e424c079dcd1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.354185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1056/2094] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:30 2022] DELETE /identity/v3/users/3ddfee721b534e93b422e424c079dcd1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:30.359333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:30.359620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:30.360072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:30.381981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:30.383447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:30.446354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1039/2095] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:30.457184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:30.458775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:30.526692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c07202-e825-4258-8f1b-dff1d9752336 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:30.531244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:30.531851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:30.532293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:30.532567 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:30.542597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:30.545956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:30.547709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:30.559559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1057/2096] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:30.619915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:30.625290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:30.641111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e5eaa-499e-4997-90e3-6462b012a4b8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:30.652392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:30.653168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:30.653530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:30.653962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] PATH_INFO: `/v3/users/9182c7bbbae941378c5822826adc7251` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:30.655849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9182c7bbbae941378c5822826adc7251)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:30.658154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:30.721532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9182c7bbbae941378c5822826adc7251'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.741089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9182c7bbbae941378c5822826adc7251'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.742219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9182c7bbbae941378c5822826adc7251'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.755815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9182c7bbbae941378c5822826adc7251'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.770582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9182c7bbbae941378c5822826adc7251'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:30.776930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1040/2097] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:30 2022] DELETE /identity/v3/users/9182c7bbbae941378c5822826adc7251 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:30.876469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:30.878287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:30.893296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6c93c-8b13-4898-8ad5-ef7dcfc90b2e service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:30.968305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:30.969041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:30.969386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:30.969749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] PATH_INFO: `/v3/projects/795b7529b74a4c11b190367476bcd67f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:30.970979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795b7529b74a4c11b190367476bcd67f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:30.972972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:31.024826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795b7529b74a4c11b190367476bcd67f', 'request_id': 'req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.025191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:31.026932 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:31.031249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795b7529b74a4c11b190367476bcd67f', 'request_id': 'req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.038042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795b7529b74a4c11b190367476bcd67f', 'request_id': 'req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.051782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] The token cache is being invalidate because project 795b7529b74a4c11b190367476bcd67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:31.052048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.052397 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1df4cd-896f-49f1-9862-7b5f25700cea admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:31.052681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.054335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1058/2098] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:30 2022] DELETE /identity/v3/projects/795b7529b74a4c11b190367476bcd67f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:31.058714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:31.060032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:31.085655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:31.114731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:31.115289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:31.115555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:31.115858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] PATH_INFO: `/v3/projects/fba7b5e105544060b90c4febd2ba08b5` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:31.116995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba7b5e105544060b90c4febd2ba08b5)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:31.118957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:31.137366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24036d0e-18f7-4ecd-a3e1-3fa8f874afc1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:31.144797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:31.145715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:31.146601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:31.146940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] PATH_INFO: `/v3/users/b4ca553a94514197a7fbd5fbe26e2e85` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:31.148480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ca553a94514197a7fbd5fbe26e2e85)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:31.151483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:31.173805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba7b5e105544060b90c4febd2ba08b5', 'request_id': 'req-a2125d43-608f-44f7-a45d-fdd453cc3e37'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.182408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba7b5e105544060b90c4febd2ba08b5', 'request_id': 'req-a2125d43-608f-44f7-a45d-fdd453cc3e37'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.184136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:31.191093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba7b5e105544060b90c4febd2ba08b5', 'request_id': 'req-a2125d43-608f-44f7-a45d-fdd453cc3e37'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.204216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] The token cache is being invalidate because project fba7b5e105544060b90c4febd2ba08b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:31.204578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.205180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.210193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1041/2099] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:31 2022] DELETE /identity/v3/projects/fba7b5e105544060b90c4febd2ba08b5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:31.212654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:31.215190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:31.217668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ca553a94514197a7fbd5fbe26e2e85'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.234589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ca553a94514197a7fbd5fbe26e2e85'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.253024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ca553a94514197a7fbd5fbe26e2e85'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.254073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ca553a94514197a7fbd5fbe26e2e85'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.262426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ca553a94514197a7fbd5fbe26e2e85'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.269419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1059/2100] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:31 2022] DELETE /identity/v3/users/b4ca553a94514197a7fbd5fbe26e2e85 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:31.312940 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2125d43-608f-44f7-a45d-fdd453cc3e37 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:31.383687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:31.384492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:31.384768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:31.385020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] PATH_INFO: `/v3/users/d457cf27ebed47e3bfd40ce55990547d` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:31.386181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d457cf27ebed47e3bfd40ce55990547d)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:31.388244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:31.408705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:31.459497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd457cf27ebed47e3bfd40ce55990547d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.470618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd457cf27ebed47e3bfd40ce55990547d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.471297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd457cf27ebed47e3bfd40ce55990547d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.486184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd457cf27ebed47e3bfd40ce55990547d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.507918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd457cf27ebed47e3bfd40ce55990547d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.521373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1042/2101] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:31 2022] DELETE /identity/v3/users/d457cf27ebed47e3bfd40ce55990547d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:31.601057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:31.602556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:31.616861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653e746-6ddb-460d-8a44-f62849a8a14a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:31.704584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:31.705244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:31.705892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:31.705892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] PATH_INFO: `/v3/projects/ca8755daf06f408793fba46a7847c9f8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:31.707372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8755daf06f408793fba46a7847c9f8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:31.709267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:31.770595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8755daf06f408793fba46a7847c9f8', 'request_id': 'req-4d5de243-5389-4e7b-834c-22f914c6b2d8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.781244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:31.783113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:31.787761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8755daf06f408793fba46a7847c9f8', 'request_id': 'req-4d5de243-5389-4e7b-834c-22f914c6b2d8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.798874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3de3e-5919-40df-a712-27689db74894 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:31.799785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8755daf06f408793fba46a7847c9f8', 'request_id': 'req-4d5de243-5389-4e7b-834c-22f914c6b2d8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.822989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] The token cache is being invalidate because project ca8755daf06f408793fba46a7847c9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:31.823540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.824515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.826067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1060/2102] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:31 2022] DELETE /identity/v3/projects/ca8755daf06f408793fba46a7847c9f8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:31.829950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:31.831579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:31.872176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:31.874886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:31.875536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:31.875875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:31.876146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] PATH_INFO: `/v3/projects/3576685d6af944eda3e1b1cf5f35a8d1` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:31.877664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3576685d6af944eda3e1b1cf5f35a8d1)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:31.880056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:31.909163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de243-5389-4e7b-834c-22f914c6b2d8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:31.915132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:31.915708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:31.915991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:31.916269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] PATH_INFO: `/v3/users/842f9447b9a446b2a7c699fe92721e93` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:31.917421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] RBAC: Authorizing `identity:delete_user(user_id=842f9447b9a446b2a7c699fe92721e93)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:31.919381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:31.937375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3576685d6af944eda3e1b1cf5f35a8d1', 'request_id': 'req-f42c993e-39b2-428a-8bf9-2c7c163862a4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.947627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3576685d6af944eda3e1b1cf5f35a8d1', 'request_id': 'req-f42c993e-39b2-428a-8bf9-2c7c163862a4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.957631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3576685d6af944eda3e1b1cf5f35a8d1', 'request_id': 'req-f42c993e-39b2-428a-8bf9-2c7c163862a4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.970782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] The token cache is being invalidate because project 3576685d6af944eda3e1b1cf5f35a8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:31.971254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.972653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f42c993e-39b2-428a-8bf9-2c7c163862a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.974151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842f9447b9a446b2a7c699fe92721e93'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:31.978291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1043/2103] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:31 2022] DELETE /identity/v3/projects/3576685d6af944eda3e1b1cf5f35a8d1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:31.980955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c795d6e-9463-4dec-b215-2ffc51790e42 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:31.980955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c795d6e-9463-4dec-b215-2ffc51790e42 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:31.980955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c795d6e-9463-4dec-b215-2ffc51790e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:31.985355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842f9447b9a446b2a7c699fe92721e93'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.000502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842f9447b9a446b2a7c699fe92721e93'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.001241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842f9447b9a446b2a7c699fe92721e93'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.004213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1c795d6e-9463-4dec-b215-2ffc51790e42 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:32.005437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1c795d6e-9463-4dec-b215-2ffc51790e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:32.009117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e30ccbfd-d6b2-4b46-9892-676ffd39956a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842f9447b9a446b2a7c699fe92721e93'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.016412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1061/2104] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:31 2022] DELETE /identity/v3/users/842f9447b9a446b2a7c699fe92721e93 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:32.025627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:32.093834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1044/2105] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:32.101117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860724d-fe9d-4050-a1ac-a6d27fa72a27 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.101398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860724d-fe9d-4050-a1ac-a6d27fa72a27 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.101670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860724d-fe9d-4050-a1ac-a6d27fa72a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.127021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-5860724d-fe9d-4050-a1ac-a6d27fa72a27 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:32.128335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5860724d-fe9d-4050-a1ac-a6d27fa72a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:32.214322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1062/2106] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:32.214944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c795d6e-9463-4dec-b215-2ffc51790e42 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.225728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c795d6e-9463-4dec-b215-2ffc51790e42 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.231388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.232279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.233711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.234217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.235068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:32.235589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.237391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.252095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1045/2107] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:59:32.256773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860724d-fe9d-4050-a1ac-a6d27fa72a27 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.266845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860724d-fe9d-4050-a1ac-a6d27fa72a27 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.271936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.272543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.272820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.273093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.273726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.275689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.310177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1063/2108] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:32.312260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.322736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d2197-e2d2-4493-8e29-848ebaf3e2ac admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.400587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.401287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.401640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.401985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.402734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.405494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.433605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1046/2109] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:32.434876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.456940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92bdf5-cd25-4ff7-8ce6-25d88fb686ea admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.461897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.462544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.462829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.463102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.463752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.465415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.475880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1064/2110] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:32.479851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.489981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3cb0f-edec-4683-b533-507b2681e140 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.494652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e73db5-3f39-453b-8bb4-a3e6a4eba334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.495252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73db5-3f39-453b-8bb4-a3e6a4eba334 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.495532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73db5-3f39-453b-8bb4-a3e6a4eba334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.495801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e73db5-3f39-453b-8bb4-a3e6a4eba334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.496441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e73db5-3f39-453b-8bb4-a3e6a4eba334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.498786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e73db5-3f39-453b-8bb4-a3e6a4eba334 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.511020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1047/2111] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:59:32.516409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.529817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96c944-ab8a-43e4-ba9a-05dbc4b51e74 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.534891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.535549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.535845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.536108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] PATH_INFO: `/v3/projects/bec70cb6bb8b47fd86aff4cdcf74bb8b/users/f00c157fd22947a0bbb53191173750c2/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.553113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec70cb6bb8b47fd86aff4cdcf74bb8b, user_id=f00c157fd22947a0bbb53191173750c2, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.555805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.559931 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:32.573404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1065/2112] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:32 2022] PUT /identity/v3/projects/bec70cb6bb8b47fd86aff4cdcf74bb8b/users/f00c157fd22947a0bbb53191173750c2/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:32.584872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cb1c1-8f75-4ede-b213-dd00ec463e8c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.585167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cb1c1-8f75-4ede-b213-dd00ec463e8c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.585520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cb1c1-8f75-4ede-b213-dd00ec463e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.598477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.600841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:32.616866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d68cb1c1-8f75-4ede-b213-dd00ec463e8c None None] MFA Rules not processed for user `f00c157fd22947a0bbb53191173750c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:32.618634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d68cb1c1-8f75-4ede-b213-dd00ec463e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:32.690864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d3b1e-cbe4-430b-b914-87fc04abe11d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.703166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.703821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.704103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.704378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] PATH_INFO: `/v3/projects/76864f5a8ade4059a3b29120d4a82118` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.705761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76864f5a8ade4059a3b29120d4a82118)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.707855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.719022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1048/2113] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:32.723388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cb1c1-8f75-4ede-b213-dd00ec463e8c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.735008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68cb1c1-8f75-4ede-b213-dd00ec463e8c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.740035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.740679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.740960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.741315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.741974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.744707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.761647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:32.768632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76864f5a8ade4059a3b29120d4a82118', 'request_id': 'req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.775000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76864f5a8ade4059a3b29120d4a82118', 'request_id': 'req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.780075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1049/2114] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:32.781719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76864f5a8ade4059a3b29120d4a82118', 'request_id': 'req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.784986 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.796978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] The token cache is being invalidate because project 76864f5a8ade4059a3b29120d4a82118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:32.797340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.798078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-9cd2ddab-72e3-4e84-b810-18d2cb2dea80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:32.799971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1066/2115] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:32 2022] DELETE /identity/v3/projects/76864f5a8ade4059a3b29120d4a82118 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:32.805780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf9f8-f919-4817-93de-153b79298f52 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.806716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf9f8-f919-4817-93de-153b79298f52 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.806998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf9f8-f919-4817-93de-153b79298f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.831453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-cfecf9f8-f919-4817-93de-153b79298f52 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:32.832697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cfecf9f8-f919-4817-93de-153b79298f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:32.867314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a66c-44d7-4379-ba3d-8b2c03afac52 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.875216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.875891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.876326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.876736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.877370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.879830 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.905685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1067/2116] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:32.913367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d830c4-9faa-4c6d-a029-99129c700cee None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.913652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d830c4-9faa-4c6d-a029-99129c700cee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.913928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d830c4-9faa-4c6d-a029-99129c700cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.914628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1050/2117] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:32.918681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.921532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:32.934276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85e787-5251-454b-8891-e31a56b9f746 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.939318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-83d830c4-9faa-4c6d-a029-99129c700cee None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:32.940164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.940552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-83d830c4-9faa-4c6d-a029-99129c700cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:32.940912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.941259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.941644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.942319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.944196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.952118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1068/2118] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:32.953479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d830c4-9faa-4c6d-a029-99129c700cee None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.958605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1051/2119] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:32.959934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:32.964463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d830c4-9faa-4c6d-a029-99129c700cee None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.970658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.971370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.971715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.972056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.972777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:32.973145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:32.974617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe2736-a703-4728-a117-0013df282a28 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:32.974960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:32.981308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:32.982071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:32.983737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:32.984016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] PATH_INFO: `/v3/projects/4645768f79134413b885e76585787391/users/b06763bfae3a4478a12793567e22f6f3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:32.991522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1069/2120] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:59:32.996078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.005424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4645768f79134413b885e76585787391, user_id=b06763bfae3a4478a12793567e22f6f3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.007521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f1821-f5c1-4848-a014-accb7c259f4e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.008195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.013080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.013880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.014415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.014514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.015119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.017241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.022276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:33.023744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1052/2121] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:32 2022] PUT /identity/v3/projects/4645768f79134413b885e76585787391/users/b06763bfae3a4478a12793567e22f6f3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:33.027028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.055100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1070/2122] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:32 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:33.058694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.103246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43367040-8dec-4bfc-83b3-5edfbc899c78 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.133670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f97cdf-648d-47ac-9c67-d8f03d97b7e9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.145737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.146429 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.146715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.146992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.148069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.150556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.162133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:33.172068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.172738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.173051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.173360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.174062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.176828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.190046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1053/2123] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:59:33.192541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1071/2124] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:33 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:33.196802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.196945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.209321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5f3bf-558f-4cfb-b427-6b900d830248 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.215119 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.215664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.216473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.216473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.217471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.218602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e02e7-c775-4b8d-b064-0b4c5695d052 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.222655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.224136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec38d8-d872-4ae6-be1b-cca60dc0c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.225611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec38d8-d872-4ae6-be1b-cca60dc0c43a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.225611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec38d8-d872-4ae6-be1b-cca60dc0c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.225611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec38d8-d872-4ae6-be1b-cca60dc0c43a admin admin] PATH_INFO: `/v3/projects/4645768f79134413b885e76585787391/users/b06763bfae3a4478a12793567e22f6f3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.228009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec38d8-d872-4ae6-be1b-cca60dc0c43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4645768f79134413b885e76585787391, user_id=b06763bfae3a4478a12793567e22f6f3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.231458 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec38d8-d872-4ae6-be1b-cca60dc0c43a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.235528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1054/2125] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:59:33.239777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.249908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1072/2126] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:33 2022] PUT /identity/v3/projects/4645768f79134413b885e76585787391/users/b06763bfae3a4478a12793567e22f6f3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:33.255503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29936db-5888-43f1-a28d-c10db46ee668 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.260920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.261374 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.261653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.294929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] MFA Rules not processed for user `b06763bfae3a4478a12793567e22f6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:33.296538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:33.325189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.327095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.327385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.327809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.328817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.330529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.346262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1055/2127] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:33.347526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.359274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933611d-3223-42ba-a248-8260ca24e705 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.366233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295eda6-7c50-4f8c-b39a-5373e2411caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.367905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295eda6-7c50-4f8c-b39a-5373e2411caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.368635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295eda6-7c50-4f8c-b39a-5373e2411caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.369258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295eda6-7c50-4f8c-b39a-5373e2411caf admin admin] PATH_INFO: `/v3/projects/0f0ad164d987410b9f86823fb6efd65a/users/bb341b18ae9041c2a10177f2a6000513/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.385267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1073/2128] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:33.389262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295eda6-7c50-4f8c-b39a-5373e2411caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0ad164d987410b9f86823fb6efd65a, user_id=bb341b18ae9041c2a10177f2a6000513, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.392316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295eda6-7c50-4f8c-b39a-5373e2411caf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.393888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.395449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:33.424389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1056/2129] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:33 2022] PUT /identity/v3/projects/0f0ad164d987410b9f86823fb6efd65a/users/bb341b18ae9041c2a10177f2a6000513/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:33.430694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.431049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.431394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.450776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:33.452192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:33.454869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:33.462696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ed85c-fe1b-4cf9-95fb-f0fe11a9cc68 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.512016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.512625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.512908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.513185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.515168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1057/2130] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:33.525233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.526738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:33.581623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.583104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.584360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a15eb8-e43f-4859-91d8-724ff3fc0f8b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.588047 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be01f0-161c-40ff-80d5-b9e20e1641da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.588643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be01f0-161c-40ff-80d5-b9e20e1641da service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.588918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be01f0-161c-40ff-80d5-b9e20e1641da service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.589188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be01f0-161c-40ff-80d5-b9e20e1641da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.592963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1074/2131] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:59:33.597046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:33.599759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be01f0-161c-40ff-80d5-b9e20e1641da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.602308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be01f0-161c-40ff-80d5-b9e20e1641da service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.614612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1058/2132] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 14:59:33.638572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:33.640033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:33.651723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990a383-3dff-4d0e-abbd-b277451ef31d service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:33.656621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:33.657229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:33.657507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:33.657777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:33.659555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:33.734582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:33.736213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:33.751210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1075/2133] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:34.341317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811370d6-926f-4604-a2f1-348452756f65 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:34.341896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811370d6-926f-4604-a2f1-348452756f65 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:34.341896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811370d6-926f-4604-a2f1-348452756f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:34.370845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-811370d6-926f-4604-a2f1-348452756f65 None None] MFA Rules not processed for user `bb341b18ae9041c2a10177f2a6000513`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:34.372059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-811370d6-926f-4604-a2f1-348452756f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:34.448160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1059/2134] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:34.457059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:34.471340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680495-9a51-4844-9a3a-3a838db981cd service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:34.476046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:34.476714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:34.477096 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:34.477478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:34.495427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:34.496852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:34.507868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1076/2135] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:35.877842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba2741-e500-4cbf-9872-eea3c8593dbc None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:35.878449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba2741-e500-4cbf-9872-eea3c8593dbc None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:35.878449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba2741-e500-4cbf-9872-eea3c8593dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:35.912534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-69ba2741-e500-4cbf-9872-eea3c8593dbc None None] MFA Rules not processed for user `bb341b18ae9041c2a10177f2a6000513`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:35.913743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-69ba2741-e500-4cbf-9872-eea3c8593dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:35.921255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1060/2136] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:37.265202 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:37.276244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3ba3-80f5-4ca6-a7fc-0236587ac427 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:37.282803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:37.283425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:37.283705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:37.283975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] PATH_INFO: `/v3/users/f00c157fd22947a0bbb53191173750c2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:37.285082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00c157fd22947a0bbb53191173750c2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:37.288624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:37.323113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:37.336722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00c157fd22947a0bbb53191173750c2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:37.344401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00c157fd22947a0bbb53191173750c2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:37.360366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00c157fd22947a0bbb53191173750c2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:37.361040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00c157fd22947a0bbb53191173750c2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:37.368313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00c157fd22947a0bbb53191173750c2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:37.375128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1077/2137] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:37 2022] DELETE /identity/v3/users/f00c157fd22947a0bbb53191173750c2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:37.379670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:37.380129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:37.380221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:37.399257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:37.400426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:37.474498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1061/2138] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:37.485072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:37.487154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:37.553932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637148-9529-468c-b9a3-9571cda9d53b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:37.557837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:37.558558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:37.558926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:37.559255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:37.570659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:37.572108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:37.583704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1078/2139] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:37.900411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:37.901842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:37.915928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80898-2a89-4d1b-822b-459c62bc1a70 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:37.920622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:37.921264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:37.928263 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:37.928559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] PATH_INFO: `/v3/projects/bec70cb6bb8b47fd86aff4cdcf74bb8b` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:37.929765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec70cb6bb8b47fd86aff4cdcf74bb8b)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:37.931714 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:37.978802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec70cb6bb8b47fd86aff4cdcf74bb8b', 'request_id': 'req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:37.986369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec70cb6bb8b47fd86aff4cdcf74bb8b', 'request_id': 'req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:37.992651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec70cb6bb8b47fd86aff4cdcf74bb8b', 'request_id': 'req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.003062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] The token cache is being invalidate because project bec70cb6bb8b47fd86aff4cdcf74bb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:38.003344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.003992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.005447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1062/2140] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:37 2022] DELETE /identity/v3/projects/bec70cb6bb8b47fd86aff4cdcf74bb8b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:38.009413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:38.019484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4620d25-15d6-440b-a077-ddf086be5544 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:38.075018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:38.075647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:38.076615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:38.076972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] PATH_INFO: `/v3/users/b06763bfae3a4478a12793567e22f6f3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:38.078472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06763bfae3a4478a12793567e22f6f3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:38.080385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:38.125790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06763bfae3a4478a12793567e22f6f3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.132602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06763bfae3a4478a12793567e22f6f3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.133707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:38.147435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06763bfae3a4478a12793567e22f6f3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.148035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06763bfae3a4478a12793567e22f6f3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.155281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-20ea1a65-153a-4ccd-a931-83b86d326d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06763bfae3a4478a12793567e22f6f3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.161265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1079/2141] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:38 2022] DELETE /identity/v3/users/b06763bfae3a4478a12793567e22f6f3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:38.509677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:38.511730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:38.520359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:38.527350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7eeb1-ed5d-401b-8627-eccadf0e2513 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:38.583887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:38.584511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:38.584787 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:38.585055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] PATH_INFO: `/v3/projects/4645768f79134413b885e76585787391` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:38.586179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4645768f79134413b885e76585787391)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:38.588079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:38.638124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4645768f79134413b885e76585787391', 'request_id': 'req-6eaec3fa-f8db-400d-a321-048f1dad15d7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.649062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4645768f79134413b885e76585787391', 'request_id': 'req-6eaec3fa-f8db-400d-a321-048f1dad15d7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.656435 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4645768f79134413b885e76585787391', 'request_id': 'req-6eaec3fa-f8db-400d-a321-048f1dad15d7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.666951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] The token cache is being invalidate because project 4645768f79134413b885e76585787391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:38.667248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.667965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6eaec3fa-f8db-400d-a321-048f1dad15d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:38.670038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1063/2142] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:38 2022] DELETE /identity/v3/projects/4645768f79134413b885e76585787391 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 14:59:38.675159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f682-58df-4318-9612-0a86acb1132b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:38.675650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f682-58df-4318-9612-0a86acb1132b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:38.675741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4f682-58df-4318-9612-0a86acb1132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:38.703529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-74e4f682-58df-4318-9612-0a86acb1132b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:38.705527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-74e4f682-58df-4318-9612-0a86acb1132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:38.779314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1080/2143] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:38.787046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c5a7-9fa7-4701-bc6f-264757d074e6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:38.787553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c5a7-9fa7-4701-bc6f-264757d074e6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:38.788145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c5a7-9fa7-4701-bc6f-264757d074e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:38.809736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-bd67c5a7-9fa7-4701-bc6f-264757d074e6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:38.811801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bd67c5a7-9fa7-4701-bc6f-264757d074e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:38.819671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1064/2144] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:38.823764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4f682-58df-4318-9612-0a86acb1132b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:38.833771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4f682-58df-4318-9612-0a86acb1132b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:38.838385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:38.838975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:38.839253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:38.839523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:38.840152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:38.840569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:38.842376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:38.853827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1081/2145] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 14:59:38.858567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c5a7-9fa7-4701-bc6f-264757d074e6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:38.867953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c5a7-9fa7-4701-bc6f-264757d074e6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:38.881879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:38.882541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:38.882822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:38.883094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:38.883736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:38.886188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:38.934606 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1065/2146] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:38 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:38.938775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:38.949282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae2c0b-0fa3-426c-9aff-620c304fcebe admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:39.009400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:39.010006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:39.010320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:39.010592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:39.011232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:39.013262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:39.034744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1082/2147] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:38 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:39.038928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:39.049448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81d78-d8f4-41d5-90f5-86db8040cdbb admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:39.054120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:39.054730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:39.055008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:39.055278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:39.055910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:39.057499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:39.070917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1066/2148] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:39.072266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:39.082616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c98c2-a896-4652-9a5b-b600b2334e69 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:39.087201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8546-d543-4aab-ae51-38db1eac25f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:39.087793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8546-d543-4aab-ae51-38db1eac25f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:39.088068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8546-d543-4aab-ae51-38db1eac25f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:39.088339 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8546-d543-4aab-ae51-38db1eac25f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:39.088974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8546-d543-4aab-ae51-38db1eac25f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:39.090683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8546-d543-4aab-ae51-38db1eac25f1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:39.101642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1083/2149] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:39.105924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:39.117492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc7c7f-16b1-4f27-8e84-e23ed530ab38 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:39.122355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:39.123194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:39.123641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:39.124084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] PATH_INFO: `/v3/projects/828e11f71c46410093e856c8231dcaa2/users/9793e9ec2842481c8f6269f951ac06ad/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:39.141713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828e11f71c46410093e856c8231dcaa2, user_id=9793e9ec2842481c8f6269f951ac06ad, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:39.144730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:39.158997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1067/2150] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:39 2022] PUT /identity/v3/projects/828e11f71c46410093e856c8231dcaa2/users/9793e9ec2842481c8f6269f951ac06ad/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:39.172594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fecf25-790c-411f-8103-d174b39d3278 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:39.172873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fecf25-790c-411f-8103-d174b39d3278 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:39.173140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fecf25-790c-411f-8103-d174b39d3278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:39.215732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-01fecf25-790c-411f-8103-d174b39d3278 None None] MFA Rules not processed for user `9793e9ec2842481c8f6269f951ac06ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:39.217599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-01fecf25-790c-411f-8103-d174b39d3278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:39.246512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:39.297182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1084/2151] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:39.308468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:39.310261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:39.342624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:39.368980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae122f0-c5af-4721-a752-11da77310cc3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:39.372900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7207c5-c8ac-4229-bf54-da742be1089b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:39.373557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7207c5-c8ac-4229-bf54-da742be1089b service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:39.373833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7207c5-c8ac-4229-bf54-da742be1089b service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:39.374190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7207c5-c8ac-4229-bf54-da742be1089b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:39.383381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7207c5-c8ac-4229-bf54-da742be1089b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:39.384801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7207c5-c8ac-4229-bf54-da742be1089b service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:39.396895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1068/2152] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:44.830852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fecf25-790c-411f-8103-d174b39d3278 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:44.893308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fecf25-790c-411f-8103-d174b39d3278 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:44.897743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:44.898384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:44.898664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:44.898938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] PATH_INFO: `/v3/users/9793e9ec2842481c8f6269f951ac06ad` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:44.900033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9793e9ec2842481c8f6269f951ac06ad)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:44.901950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:44.948239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9793e9ec2842481c8f6269f951ac06ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:44.955869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9793e9ec2842481c8f6269f951ac06ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:44.968846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9793e9ec2842481c8f6269f951ac06ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:44.969478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9793e9ec2842481c8f6269f951ac06ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:44.976474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9793e9ec2842481c8f6269f951ac06ad'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:44.982917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1085/2153] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:44 2022] DELETE /identity/v3/users/9793e9ec2842481c8f6269f951ac06ad => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:44.987469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:44.987941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:44.988034 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.006805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:45.007979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:45.069627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1069/2154] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:45.079310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:45.080757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:45.144261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:45.150544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19ded3-f549-4d53-ad85-0c241962f098 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:45.155839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc613baa-2f92-4171-a340-fe3b290eb1a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:45.156438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613baa-2f92-4171-a340-fe3b290eb1a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:45.156715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613baa-2f92-4171-a340-fe3b290eb1a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:45.156984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc613baa-2f92-4171-a340-fe3b290eb1a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.166008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc613baa-2f92-4171-a340-fe3b290eb1a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:45.167464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc613baa-2f92-4171-a340-fe3b290eb1a2 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:45.177723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1086/2155] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:45.554642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:45.555825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:45.568853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015e8b4-8cb9-482b-89b9-f90f27b2c824 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:45.574561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:45.575266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:45.576217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:45.576591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] PATH_INFO: `/v3/projects/828e11f71c46410093e856c8231dcaa2` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.577858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=828e11f71c46410093e856c8231dcaa2)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:45.579917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:45.630988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828e11f71c46410093e856c8231dcaa2', 'request_id': 'req-f98f8d53-5375-423a-9525-d68884c91009'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:45.640596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828e11f71c46410093e856c8231dcaa2', 'request_id': 'req-f98f8d53-5375-423a-9525-d68884c91009'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:45.647360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828e11f71c46410093e856c8231dcaa2', 'request_id': 'req-f98f8d53-5375-423a-9525-d68884c91009'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:45.658291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] The token cache is being invalidate because project 828e11f71c46410093e856c8231dcaa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:45.658576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:45.659224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f98f8d53-5375-423a-9525-d68884c91009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:45.660757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1070/2156] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:45 2022] DELETE /identity/v3/projects/828e11f71c46410093e856c8231dcaa2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:45.666435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a377f-15d5-47df-a04e-1113f5c55217 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:45.666784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a377f-15d5-47df-a04e-1113f5c55217 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:45.667120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a377f-15d5-47df-a04e-1113f5c55217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.689063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c75a377f-15d5-47df-a04e-1113f5c55217 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:45.690410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c75a377f-15d5-47df-a04e-1113f5c55217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:45.767727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1087/2157] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:45.778032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd283-0495-4e23-b49f-af6dd30bb641 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:45.778032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd283-0495-4e23-b49f-af6dd30bb641 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:45.778032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd283-0495-4e23-b49f-af6dd30bb641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.803331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b70dd283-0495-4e23-b49f-af6dd30bb641 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:45.804666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b70dd283-0495-4e23-b49f-af6dd30bb641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:45.814114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1071/2158] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 14:59:45.817926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a377f-15d5-47df-a04e-1113f5c55217 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:45.829570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a377f-15d5-47df-a04e-1113f5c55217 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:45.834412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:45.835017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:45.835299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:45.835572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.836217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 14:59:45.836518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:45.838162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:45.851419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1088/2159] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 14:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 14:59:45.855536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dd283-0495-4e23-b49f-af6dd30bb641 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:45.866263 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dd283-0495-4e23-b49f-af6dd30bb641 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:45.870901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:45.871508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:45.871766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:45.872035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.872941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:45.874947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:45.909213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1072/2160] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 14:59:45 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 14:59:45.910365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:45.921103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2470-394e-4cc0-9ab6-73505ff19120 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:45.979676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:45.980277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:45.980558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:45.980824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:45.981455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:45.984037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:46.015384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1089/2161] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 14:59:45 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 14:59:46.016230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:46.027195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf09cd-9bf5-46f9-b8ff-63fce5b2194e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:46.033171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:46.033675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:46.033949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:46.034328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:46.034890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:46.036962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:46.048335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1073/2162] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 14:59:46.053821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:46.066528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ec378-eb36-4372-a142-044262fc63a5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:46.072011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f3b70-b030-4e6d-98da-c107fcad2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:46.072775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3b70-b030-4e6d-98da-c107fcad2316 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:46.073148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3b70-b030-4e6d-98da-c107fcad2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:46.073587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f3b70-b030-4e6d-98da-c107fcad2316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:46.074383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f3b70-b030-4e6d-98da-c107fcad2316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:46.090777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f3b70-b030-4e6d-98da-c107fcad2316 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:46.112131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1090/2163] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 14:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 14:59:46.116265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:46.127643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5716de1-3ea7-4596-8f6c-37c1a3eec174 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:46.132593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:46.133494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:46.133951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:46.134257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] PATH_INFO: `/v3/projects/bc7772eacb154d14804bd1da9b24bf76/users/690e331fd959451a8f6498e458cd443d/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:46.156023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:46.161851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7772eacb154d14804bd1da9b24bf76, user_id=690e331fd959451a8f6498e458cd443d, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:46.164735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:46.184599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1074/2164] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 14:59:46 2022] PUT /identity/v3/projects/bc7772eacb154d14804bd1da9b24bf76/users/690e331fd959451a8f6498e458cd443d/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:46.195887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:46.195887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:46.196134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:46.232819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] MFA Rules not processed for user `690e331fd959451a8f6498e458cd443d`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:46.234039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:46.284904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:46.308045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1091/2165] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:46.320618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:46.322391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:46.389978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90ff99-30c5-4566-b4e1-c0e4bc6296f6 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:46.394564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64b71e-9252-4f4b-b0b8-487e66c5d531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:46.395171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b71e-9252-4f4b-b0b8-487e66c5d531 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:46.395448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b71e-9252-4f4b-b0b8-487e66c5d531 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:46.395712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64b71e-9252-4f4b-b0b8-487e66c5d531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:46.405701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64b71e-9252-4f4b-b0b8-487e66c5d531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:46.406692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64b71e-9252-4f4b-b0b8-487e66c5d531 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:46.421903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1075/2166] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:47.298622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:47.300068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:47.364508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea97cf1-d115-4bd9-8acb-60da7cd76916 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:47.368914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:47.369525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:47.369802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:47.370071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] PATH_INFO: `/v3/users/b96a4f1a6cc64778962f4c7bcd3b05fc` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:47.371190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96a4f1a6cc64778962f4c7bcd3b05fc)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:47.373085 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:47.419468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96a4f1a6cc64778962f4c7bcd3b05fc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:47.427260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96a4f1a6cc64778962f4c7bcd3b05fc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:47.438921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96a4f1a6cc64778962f4c7bcd3b05fc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:47.439540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96a4f1a6cc64778962f4c7bcd3b05fc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:47.446224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96a4f1a6cc64778962f4c7bcd3b05fc'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:47.451975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1092/2167] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 14:59:47 2022] DELETE /identity/v3/users/b96a4f1a6cc64778962f4c7bcd3b05fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:47.456749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:47.457234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:47.457338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:47.476528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:47.477712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:47.535665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1076/2168] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:47.545201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:47.547148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:47.607771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056bedd-36d0-4090-a455-0950b1da7f41 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:47.611677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaadd05-e478-4981-80be-871acef4c0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:47.612268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaadd05-e478-4981-80be-871acef4c0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:47.612543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaadd05-e478-4981-80be-871acef4c0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:47.612810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaadd05-e478-4981-80be-871acef4c0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:47.621563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaadd05-e478-4981-80be-871acef4c0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:47.623006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaadd05-e478-4981-80be-871acef4c0d8 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:47.633164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1093/2169] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 14:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 14:59:48.135136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:48.140584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:48.160874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4f8f0-3889-4cda-86a1-c484eff7c2a7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:48.166117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:48.166885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:48.167378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:48.167746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] PATH_INFO: `/v3/projects/5b92fd55e2a54c81a579b8b348d9e081` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:48.169056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b92fd55e2a54c81a579b8b348d9e081)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:48.171962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:48.237222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b92fd55e2a54c81a579b8b348d9e081', 'request_id': 'req-e4395150-e43d-4284-881e-a02374366a70'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:48.247741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b92fd55e2a54c81a579b8b348d9e081', 'request_id': 'req-e4395150-e43d-4284-881e-a02374366a70'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:48.256811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b92fd55e2a54c81a579b8b348d9e081', 'request_id': 'req-e4395150-e43d-4284-881e-a02374366a70'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:48.268961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] The token cache is being invalidate because project 5b92fd55e2a54c81a579b8b348d9e081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 14:59:48.269252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:48.269919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 14:59:48.271518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1077/2170] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 14:59:48 2022] DELETE /identity/v3/projects/5b92fd55e2a54c81a579b8b348d9e081 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 14:59:57.628488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:57.688241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477270c-03ea-4266-8170-bcfddc7a0c6d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:57.688526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477270c-03ea-4266-8170-bcfddc7a0c6d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:57.688801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477270c-03ea-4266-8170-bcfddc7a0c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:57.712249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b477270c-03ea-4266-8170-bcfddc7a0c6d None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 14:59:57.713469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b477270c-03ea-4266-8170-bcfddc7a0c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:57.788976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1094/2171] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 14:59:57.858031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 14:59:57.861062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 14:59:57.903204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 14:59:57.976197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4395150-e43d-4284-881e-a02374366a70 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 14:59:57.983951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad50b5b-5c74-472b-beb4-b4541f7db983 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 14:59:57.984485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50b5b-5c74-472b-beb4-b4541f7db983 service swift] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 14:59:57.984765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50b5b-5c74-472b-beb4-b4541f7db983 service swift] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 14:59:57.985038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad50b5b-5c74-472b-beb4-b4541f7db983 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 14:59:57.993708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad50b5b-5c74-472b-beb4-b4541f7db983 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 14:59:57.995343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad50b5b-5c74-472b-beb4-b4541f7db983 service swift] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 14:59:58.004934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1078/2172] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 14:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:00:07.039687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948980e5-da16-45f9-bace-fa367e9aa141 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:07.040341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948980e5-da16-45f9-bace-fa367e9aa141 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:07.040341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948980e5-da16-45f9-bace-fa367e9aa141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:07.068000 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-948980e5-da16-45f9-bace-fa367e9aa141 None None] MFA Rules not processed for user `507a05e50d1345d498bb0f06fe4ef2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:07.069627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-948980e5-da16-45f9-bace-fa367e9aa141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:07.178729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1095/2173] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:08.001471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=24 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:17.147384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=50 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:22.790862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:22.790862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:22.791365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:22.812582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:22.813820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:22.820943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1079/2174] 10.222.0.52 () {58 vars in 967 bytes} [Fri Sep 9 15:00:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:22.834732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948980e5-da16-45f9-bace-fa367e9aa141 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:22.847098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948980e5-da16-45f9-bace-fa367e9aa141 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:22.852208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:22.852814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:22.853094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:22.853365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:22.861800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:22.863416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:22.876209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1096/2175] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:00:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:00:24.836010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:24.837487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:24.904227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d82a51-16a2-450b-8f2e-a29860562c68 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:24.909703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:24.910472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:24.910998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:24.911417 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] PATH_INFO: `/v3/users/4c3e1ed61253458089f4ec31295c3294` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:24.913432 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3e1ed61253458089f4ec31295c3294)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:24.917283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:24.966173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3e1ed61253458089f4ec31295c3294'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:24.974237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3e1ed61253458089f4ec31295c3294'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:24.974851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3e1ed61253458089f4ec31295c3294'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:24.981900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3e1ed61253458089f4ec31295c3294'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:24.995816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06b6bf96-5045-4fb7-a330-aff0db0f4c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3e1ed61253458089f4ec31295c3294'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:25.002021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1080/2176] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:00:24 2022] DELETE /identity/v3/users/4c3e1ed61253458089f4ec31295c3294 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:25.257847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.280228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afd6c-4d75-45c9-8faf-ff6f550902b8 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:25.340324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:25.340951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.341226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.341495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] PATH_INFO: `/v3/projects/669f07ca5ed648f6a92d5d66d5ae29f9` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.343190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=669f07ca5ed648f6a92d5d66d5ae29f9)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:25.345080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:25.392144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669f07ca5ed648f6a92d5d66d5ae29f9', 'request_id': 'req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:25.397680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669f07ca5ed648f6a92d5d66d5ae29f9', 'request_id': 'req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:25.403832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669f07ca5ed648f6a92d5d66d5ae29f9', 'request_id': 'req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:25.416786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] The token cache is being invalidate because project 669f07ca5ed648f6a92d5d66d5ae29f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:00:25.417062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:25.417670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8e0e0660-6ca4-46d0-a5d9-2d631687c3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:25.419483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1097/2177] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:00:25 2022] DELETE /identity/v3/projects/669f07ca5ed648f6a92d5d66d5ae29f9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:25.425331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100695c-0ade-4ff6-805b-4ff4b78fd760 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.425612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100695c-0ade-4ff6-805b-4ff4b78fd760 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.425885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100695c-0ade-4ff6-805b-4ff4b78fd760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.445651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e100695c-0ade-4ff6-805b-4ff4b78fd760 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:25.446876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e100695c-0ade-4ff6-805b-4ff4b78fd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:25.506668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1081/2178] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:25.514504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96bb71-6c47-4643-8497-68c1e8dc92fd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.514876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96bb71-6c47-4643-8497-68c1e8dc92fd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.515152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96bb71-6c47-4643-8497-68c1e8dc92fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.535397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0e96bb71-6c47-4643-8497-68c1e8dc92fd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:25.536584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0e96bb71-6c47-4643-8497-68c1e8dc92fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:25.544318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1098/2179] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:25.549307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100695c-0ade-4ff6-805b-4ff4b78fd760 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.559601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100695c-0ade-4ff6-805b-4ff4b78fd760 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:25.564576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:25.565186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.565467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.565740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.566425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:00:25.566730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:25.568311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:25.577371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:25.581383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1082/2180] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:00:25.585892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96bb71-6c47-4643-8497-68c1e8dc92fd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.596454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96bb71-6c47-4643-8497-68c1e8dc92fd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:25.601168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:25.601769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.602049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.602349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.602978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:25.604870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:25.633369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1099/2181] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:00:25 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:25.637567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.648538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adde3b-f54d-407c-a8ba-f8ddb2bb6202 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:25.713076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:25.713683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.713962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.714268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.714897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:25.716810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:25.741456 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1083/2182] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:00:25 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:25.745408 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.756546 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99fa40-5c2d-4b67-9425-af9a21442e9e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:25.761127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:25.761707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.761981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.762287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.762918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:25.765243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:25.776316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1100/2183] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:25.781074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.791078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896696-0472-405e-9249-bf103c503669 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:25.796336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6dd1a8-dedb-4cd9-8826-a60e6990966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:25.796939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dd1a8-dedb-4cd9-8826-a60e6990966f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.797222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dd1a8-dedb-4cd9-8826-a60e6990966f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.797498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dd1a8-dedb-4cd9-8826-a60e6990966f admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.798169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dd1a8-dedb-4cd9-8826-a60e6990966f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:25.799766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6dd1a8-dedb-4cd9-8826-a60e6990966f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:25.810867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1084/2184] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:25.814966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.827330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee34953-ca69-4df8-8d3f-bc14d39b6c09 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:25.832194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:25.832859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.833141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.833450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] PATH_INFO: `/v3/projects/9b4ba84c56204a9a874a8a88e430d2a4/users/a40119a73f11466396851382adc1d37f/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.849100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4ba84c56204a9a874a8a88e430d2a4, user_id=a40119a73f11466396851382adc1d37f, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:25.851797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:25.866037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1101/2185] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:00:25 2022] PUT /identity/v3/projects/9b4ba84c56204a9a874a8a88e430d2a4/users/a40119a73f11466396851382adc1d37f/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:25.871157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c733b-93cb-42f4-8ff6-7eb327be8bbf None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:25.871623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c733b-93cb-42f4-8ff6-7eb327be8bbf None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:25.871733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c733b-93cb-42f4-8ff6-7eb327be8bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:25.891231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c46c733b-93cb-42f4-8ff6-7eb327be8bbf None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:25.892522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c46c733b-93cb-42f4-8ff6-7eb327be8bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:25.958757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1085/2186] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:25.968959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:25.970992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:25.986960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:26.032681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0035923-93cc-4f81-9749-7ac897adc15d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:26.036300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:26.036863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:26.037137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:26.037407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:26.046888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:26.048308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:26.057976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1102/2187] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:30.643669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352305-1959-46c2-8ee6-7b16377de9e7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:30.644227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352305-1959-46c2-8ee6-7b16377de9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:30.644227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88352305-1959-46c2-8ee6-7b16377de9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:30.673992 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-88352305-1959-46c2-8ee6-7b16377de9e7 None None] MFA Rules not processed for user `a40119a73f11466396851382adc1d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:30.675276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-88352305-1959-46c2-8ee6-7b16377de9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:30.747003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1086/2188] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:30.752560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:30.762701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7675959-b44d-4aa9-9fa6-8f0e08b2557c service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:30.767745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:30.768346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:30.768618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:30.768883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:30.769508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:30.771481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:30.800731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1103/2189] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:00:30 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:30.804537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352305-1959-46c2-8ee6-7b16377de9e7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:30.816503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88352305-1959-46c2-8ee6-7b16377de9e7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:30.821259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:30.884174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:30.885038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:30.885385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:30.885729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:30.886502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:30.888648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:30.915356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1087/2190] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:00:30 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:00:30.918983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:30.930354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a0930-a194-40ca-9972-c78c018fab0e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:30.937938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:30.938634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:30.938910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:30.939186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:30.939827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:30.941501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:30.956632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1104/2191] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:30.957766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:30.970360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86062-dfe4-48bb-ab25-ef2604e8dd95 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:30.975323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:30.975990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:30.976313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:30.976533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] PATH_INFO: `/v3/projects/381fe137aec44396aa20c6e76734f795/users/069b3d8ccba24a5aacad5401d9c2e17d/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:30.996085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381fe137aec44396aa20c6e76734f795, user_id=069b3d8ccba24a5aacad5401d9c2e17d, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:30.999451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:31.024643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1088/2192] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:00:30 2022] PUT /identity/v3/projects/381fe137aec44396aa20c6e76734f795/users/069b3d8ccba24a5aacad5401d9c2e17d/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:31.040534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:31.057558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3030efc-c72c-47f4-8332-f992237a64b1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:31.124706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475cfc-282d-46d0-80e2-bc0a9c654430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:31.125872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475cfc-282d-46d0-80e2-bc0a9c654430 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:31.126227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475cfc-282d-46d0-80e2-bc0a9c654430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:31.126631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475cfc-282d-46d0-80e2-bc0a9c654430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:31.127758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475cfc-282d-46d0-80e2-bc0a9c654430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:31.129715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475cfc-282d-46d0-80e2-bc0a9c654430 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:31.144675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1105/2193] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:31.158243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:31.174008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6142e5-d431-403e-9cef-7e517a3b3682 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:31.181035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:31.182052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:31.182390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:31.182667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] PATH_INFO: `/v3/projects/381fe137aec44396aa20c6e76734f795/users/069b3d8ccba24a5aacad5401d9c2e17d/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:31.185168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381fe137aec44396aa20c6e76734f795, user_id=069b3d8ccba24a5aacad5401d9c2e17d, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:31.187949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:31.201101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1089/2194] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:00:31 2022] PUT /identity/v3/projects/381fe137aec44396aa20c6e76734f795/users/069b3d8ccba24a5aacad5401d9c2e17d/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:36.101111 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156effa-0613-4656-99ad-41e710da1784 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:36.101575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156effa-0613-4656-99ad-41e710da1784 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:36.101743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156effa-0613-4656-99ad-41e710da1784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:36.140639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0156effa-0613-4656-99ad-41e710da1784 None None] MFA Rules not processed for user `069b3d8ccba24a5aacad5401d9c2e17d`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:36.142391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0156effa-0613-4656-99ad-41e710da1784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:36.229535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1106/2195] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:00:36.245474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:36.249088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:36.345225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f4f72-78e5-4e98-993c-b052d9c68ad0 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:36.351745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034dcce-9f37-4196-b67d-71d3ed8c7e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:36.352575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034dcce-9f37-4196-b67d-71d3ed8c7e05 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:36.352856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034dcce-9f37-4196-b67d-71d3ed8c7e05 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:36.353261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034dcce-9f37-4196-b67d-71d3ed8c7e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:36.438727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034dcce-9f37-4196-b67d-71d3ed8c7e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:36.441033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034dcce-9f37-4196-b67d-71d3ed8c7e05 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:36.446713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:36.467303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1090/2196] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:36.679844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156effa-0613-4656-99ad-41e710da1784 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:36.681267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0156effa-0613-4656-99ad-41e710da1784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:36.691248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:36.803919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156effa-0613-4656-99ad-41e710da1784 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:36.814816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:36.815726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:36.816045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:36.816379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] PATH_INFO: `/v3/users/690e331fd959451a8f6498e458cd443d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:36.817685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690e331fd959451a8f6498e458cd443d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:36.819712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:36.891018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690e331fd959451a8f6498e458cd443d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:36.901036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690e331fd959451a8f6498e458cd443d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:36.923513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690e331fd959451a8f6498e458cd443d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:36.924322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690e331fd959451a8f6498e458cd443d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:36.938783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690e331fd959451a8f6498e458cd443d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:36.947220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1107/2197] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:00:36 2022] DELETE /identity/v3/users/690e331fd959451a8f6498e458cd443d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:36.953277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:36.953767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:36.954291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:36.981147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:36.982729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:37.056432 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1091/2198] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:37.073240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:37.074755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:37.145788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159603f5-98cf-4138-834b-fe98adaf6a84 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:37.149749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e511c0-00d3-4f42-b426-face9b3be01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:37.150467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e511c0-00d3-4f42-b426-face9b3be01e service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:37.151307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e511c0-00d3-4f42-b426-face9b3be01e service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:37.151730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e511c0-00d3-4f42-b426-face9b3be01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:37.180912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e511c0-00d3-4f42-b426-face9b3be01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:37.183095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e511c0-00d3-4f42-b426-face9b3be01e service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:37.199022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1108/2199] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:37.801044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:37.807494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:37.827063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04755f1b-d477-483e-8e21-0ad6089e9b8d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:37.841534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:37.842583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:37.843057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:37.843539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] PATH_INFO: `/v3/projects/bc7772eacb154d14804bd1da9b24bf76` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:37.844946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7772eacb154d14804bd1da9b24bf76)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:37.847140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:37.978629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7772eacb154d14804bd1da9b24bf76', 'request_id': 'req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:37.994245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7772eacb154d14804bd1da9b24bf76', 'request_id': 'req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:38.006675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7772eacb154d14804bd1da9b24bf76', 'request_id': 'req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:38.028200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] The token cache is being invalidate because project bc7772eacb154d14804bd1da9b24bf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:00:38.029131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:38.030805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-80f42ebb-9ef6-4dfe-a435-a04f01e08ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:38.037593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1092/2200] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:00:37 2022] DELETE /identity/v3/projects/bc7772eacb154d14804bd1da9b24bf76 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:38.038489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfb14-7a2b-44a7-872d-47717eb1622c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.038798 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfb14-7a2b-44a7-872d-47717eb1622c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.039054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cfb14-7a2b-44a7-872d-47717eb1622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.063357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-545cfb14-7a2b-44a7-872d-47717eb1622c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:38.064813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-545cfb14-7a2b-44a7-872d-47717eb1622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:38.102555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:38.120329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb836a5-a3f2-489f-97e8-fa584671ebf8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.120876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb836a5-a3f2-489f-97e8-fa584671ebf8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.121226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb836a5-a3f2-489f-97e8-fa584671ebf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.160000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-4eb836a5-a3f2-489f-97e8-fa584671ebf8 None None] MFA Rules not processed for user `a40119a73f11466396851382adc1d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:38.161457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4eb836a5-a3f2-489f-97e8-fa584671ebf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:38.173210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1109/2201] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:00:38.181404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6910-4ddf-4029-b214-2f0e253d1b07 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.181987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6910-4ddf-4029-b214-2f0e253d1b07 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.182486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac6910-4ddf-4029-b214-2f0e253d1b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.208370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b5ac6910-4ddf-4029-b214-2f0e253d1b07 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:38.210016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b5ac6910-4ddf-4029-b214-2f0e253d1b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:38.220776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1110/2202] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:00:38.224491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6910-4ddf-4029-b214-2f0e253d1b07 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:38.237398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac6910-4ddf-4029-b214-2f0e253d1b07 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:38.242906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:38.244029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.244310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.244901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.245592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:00:38.245869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:38.248068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:38.256591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1093/2203] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:38.266846 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1111/2204] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:00:38.270845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb836a5-a3f2-489f-97e8-fa584671ebf8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:38.291338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb836a5-a3f2-489f-97e8-fa584671ebf8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:38.298168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:38.298899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.299290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.299660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.300568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:38.307995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:38.384550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1094/2205] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:00:38 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:00:38.389346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:38.406063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de246-c953-4cec-9437-db4d35c83ac0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:38.523636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:38.524267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.524545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.524816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.525454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:38.529706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:38.581917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1112/2206] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:00:38 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:38.588112 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:38.598520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:38.609465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb713d-56d5-4959-9502-16069eba4941 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:38.625392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:38.626537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.626880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.627214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.628088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:38.629857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:38.659209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1095/2207] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:38.663580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:38.682330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25767eb3-ed59-4786-9736-93a49c721476 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:38.693903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8c425-701f-45ca-9cb2-032799df4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:38.695312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8c425-701f-45ca-9cb2-032799df4e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.695762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8c425-701f-45ca-9cb2-032799df4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.696137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8c425-701f-45ca-9cb2-032799df4e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.696885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8c425-701f-45ca-9cb2-032799df4e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:38.699365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8c425-701f-45ca-9cb2-032799df4e19 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:38.723123 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:38.730474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1113/2208] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:38.737447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988f1e8-51bc-4abe-ad62-1e4f5c813ba1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:38.744689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:38.748020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.748501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.748832 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] PATH_INFO: `/v3/projects/dc891a70ee514b8597ead63169921e07/users/0ae69171bd7248d198f07dfd461bd653/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.770801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc891a70ee514b8597ead63169921e07, user_id=0ae69171bd7248d198f07dfd461bd653, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:38.774021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:38.798259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1096/2209] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:00:38 2022] PUT /identity/v3/projects/dc891a70ee514b8597ead63169921e07/users/0ae69171bd7248d198f07dfd461bd653/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:38.809319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0a53-9d3e-49be-9510-67301bae8ade None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:38.809610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0a53-9d3e-49be-9510-67301bae8ade None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:38.809905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0a53-9d3e-49be-9510-67301bae8ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:38.855162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-159a0a53-9d3e-49be-9510-67301bae8ade None None] MFA Rules not processed for user `0ae69171bd7248d198f07dfd461bd653`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:38.856884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-159a0a53-9d3e-49be-9510-67301bae8ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:39.035048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1114/2210] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:00:39.049205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:39.051802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:39.129795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c2750-8086-42cc-b3c5-13ad84a67299 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:39.134454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c0c24-5a6a-4426-ac6b-229b9cb97d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:39.134956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0c24-5a6a-4426-ac6b-229b9cb97d94 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:39.135195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0c24-5a6a-4426-ac6b-229b9cb97d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:39.135540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0c24-5a6a-4426-ac6b-229b9cb97d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:39.147060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c0c24-5a6a-4426-ac6b-229b9cb97d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:39.148520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c0c24-5a6a-4426-ac6b-229b9cb97d94 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:39.159661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1097/2211] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:39.188244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0a53-9d3e-49be-9510-67301bae8ade None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:39.213633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:39.299720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0a53-9d3e-49be-9510-67301bae8ade None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:39.309514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:39.310281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:39.310556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:39.311125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] PATH_INFO: `/v3/users/0ae69171bd7248d198f07dfd461bd653` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:39.312541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae69171bd7248d198f07dfd461bd653)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:39.314559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:39.377611 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae69171bd7248d198f07dfd461bd653'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:39.398702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae69171bd7248d198f07dfd461bd653'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:39.421802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae69171bd7248d198f07dfd461bd653'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:39.422654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae69171bd7248d198f07dfd461bd653'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:39.431513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae69171bd7248d198f07dfd461bd653'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:39.442115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1115/2212] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:00:39 2022] DELETE /identity/v3/users/0ae69171bd7248d198f07dfd461bd653 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:39.444661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:39.444945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:39.445215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:39.472460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:39.473774 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:39.561409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1098/2213] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:39.576147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:39.578502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:39.640775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298358e4-d6ca-4277-a41d-24e8a5484156 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:39.650378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b04996-46e0-4455-a66a-720bf649a86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:39.651395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04996-46e0-4455-a66a-720bf649a86a service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:39.651747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04996-46e0-4455-a66a-720bf649a86a service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:39.652679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b04996-46e0-4455-a66a-720bf649a86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:39.668579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b04996-46e0-4455-a66a-720bf649a86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:39.670209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b04996-46e0-4455-a66a-720bf649a86a service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:39.680321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1116/2214] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:39.983832 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:39.985574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:40.011739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25598b8-d7ef-447c-957a-7ddc455d2f9b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.017707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.018383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.018731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.019009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] PATH_INFO: `/v3/projects/dc891a70ee514b8597ead63169921e07` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.020385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc891a70ee514b8597ead63169921e07)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.022537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.098733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc891a70ee514b8597ead63169921e07', 'request_id': 'req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:40.108166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc891a70ee514b8597ead63169921e07', 'request_id': 'req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:40.115399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc891a70ee514b8597ead63169921e07', 'request_id': 'req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:40.120559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:40.136900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] The token cache is being invalidate because project dc891a70ee514b8597ead63169921e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:00:40.137212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:40.138833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f7d4e71d-9c9b-4dcb-a6ac-b42e6cafb8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:00:40.144029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1099/2215] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:00:39 2022] DELETE /identity/v3/projects/dc891a70ee514b8597ead63169921e07 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:40.145625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f97ce-5db5-4eea-84e1-be6777f43725 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.145912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f97ce-5db5-4eea-84e1-be6777f43725 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.146221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f97ce-5db5-4eea-84e1-be6777f43725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.166927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d62f97ce-5db5-4eea-84e1-be6777f43725 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:40.168145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d62f97ce-5db5-4eea-84e1-be6777f43725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:40.219118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:40.256800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1117/2216] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:40.265803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5dcf-d310-4806-910c-c7b37de1beb7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.266112 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5dcf-d310-4806-910c-c7b37de1beb7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.266399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f5dcf-d310-4806-910c-c7b37de1beb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.287213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-469f5dcf-d310-4806-910c-c7b37de1beb7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:40.288461 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-469f5dcf-d310-4806-910c-c7b37de1beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:40.297450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1100/2217] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:40.301989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f97ce-5db5-4eea-84e1-be6777f43725 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:40.318345 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f97ce-5db5-4eea-84e1-be6777f43725 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.323238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.323997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.324355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.324635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.325293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:00:40.325663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.327300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.342121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1118/2218] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:00:40.344815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f5dcf-d310-4806-910c-c7b37de1beb7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:40.354737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f5dcf-d310-4806-910c-c7b37de1beb7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.359408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.360021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.360288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.360562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.361191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.363312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.391762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1101/2219] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:00:40 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:40.395898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:40.407028 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04bbf8-af4a-496b-9453-005b04ceb7ec admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.469535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.470244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.470525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.470815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.471487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.473645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.498184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1119/2220] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:00:40 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:40.499362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:40.509501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f1e1-cc5b-427d-9083-34328b91f4b0 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.514629 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.515223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.515496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.515766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.516401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.517973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.528082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1102/2221] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:40.532813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:40.542860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ff1ed-3fbd-49d5-80ed-96e909a755ae admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.547728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bec15-b4fc-4a3d-b2db-dcfb3f5200aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.548320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bec15-b4fc-4a3d-b2db-dcfb3f5200aa admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.548602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bec15-b4fc-4a3d-b2db-dcfb3f5200aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.548874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bec15-b4fc-4a3d-b2db-dcfb3f5200aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.549508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bec15-b4fc-4a3d-b2db-dcfb3f5200aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.551208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bec15-b4fc-4a3d-b2db-dcfb3f5200aa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.562306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1120/2222] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:40.566381 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:40.584216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57099fd-6c6d-4463-ac9b-afbdc95ae67e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.590364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.591824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.592111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.592386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] PATH_INFO: `/v3/projects/751836838860475192d5deb3f365b904/users/ac01b2470edc4224be3eeda9aaf0d57f/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.609102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=751836838860475192d5deb3f365b904, user_id=ac01b2470edc4224be3eeda9aaf0d57f, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.611718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.625089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1103/2223] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:00:40 2022] PUT /identity/v3/projects/751836838860475192d5deb3f365b904/users/ac01b2470edc4224be3eeda9aaf0d57f/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:40.630148 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd4ef5-9373-4043-920d-51a15f574083 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.630434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd4ef5-9373-4043-920d-51a15f574083 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.630759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd4ef5-9373-4043-920d-51a15f574083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.649940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7bbd4ef5-9373-4043-920d-51a15f574083 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:40.651301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7bbd4ef5-9373-4043-920d-51a15f574083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:40.719195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1121/2224] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:40.728977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:40.730791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:40.800751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92fe04-24dd-4676-b503-0586f34ad13f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:40.806132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5425b68-dc2f-4749-95c0-d97fc181f7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:40.806516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425b68-dc2f-4749-95c0-d97fc181f7af service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:40.806798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425b68-dc2f-4749-95c0-d97fc181f7af service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:40.807082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425b68-dc2f-4749-95c0-d97fc181f7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:40.817622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5425b68-dc2f-4749-95c0-d97fc181f7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:40.819103 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5425b68-dc2f-4749-95c0-d97fc181f7af service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:40.832802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1104/2225] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:45.284042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.284866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.285615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.334745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:45.336130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:45.351032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b48b-a2a1-495c-91d4-e3148966df87 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.352659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b48b-a2a1-495c-91d4-e3148966df87 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.353131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395b48b-a2a1-495c-91d4-e3148966df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.354029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1122/2226] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:45.385221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:45.386642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:45.389083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6395b48b-a2a1-495c-91d4-e3148966df87 None None] MFA Rules not processed for user `ac01b2470edc4224be3eeda9aaf0d57f`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:45.390729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6395b48b-a2a1-495c-91d4-e3148966df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:45.435592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:45.490193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927f014-90bf-4423-910a-87ada2cdb281 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:45.497434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:45.498411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.498630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1105/2227] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:45.502370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.502674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.503683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b48b-a2a1-495c-91d4-e3148966df87 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:45.514177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:45.516267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:45.520558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395b48b-a2a1-495c-91d4-e3148966df87 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:45.525621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:45.526286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.526562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.526828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.527459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:45.529569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1123/2228] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:00:45.530556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:45.559755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1106/2229] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:00:45 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:45.563712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:45.573530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c300da-5d45-451a-9b42-9b01231bc995 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:45.643317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:45.644133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.644480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.644817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.645538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:45.647693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:45.672183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1124/2230] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:00:45 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:00:45.676870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:45.683538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:45.695690 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73761822-0c3a-43d5-a01f-e6a236debb90 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:45.708229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:45.708859 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.709142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.709414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.710170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:45.713037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:45.726041 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1107/2231] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:45.730392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:45.742281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9796c-0dab-4884-bd57-e6c4e28a2981 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:45.746892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:45.747820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.748092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.748358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] PATH_INFO: `/v3/projects/14b44238df0443cc8daeb5af93071892/users/22c48028f3814bcaa3b165e783c5355e/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.766698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b44238df0443cc8daeb5af93071892, user_id=22c48028f3814bcaa3b165e783c5355e, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:45.769279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:45.783162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1125/2232] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:00:45 2022] PUT /identity/v3/projects/14b44238df0443cc8daeb5af93071892/users/22c48028f3814bcaa3b165e783c5355e/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:00:45.787182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:45.798039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca17587-29a7-49f9-ac5e-663a7c1cbb89 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:45.878930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540aea8-2598-486a-aff2-ab80d57935b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:45.879549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540aea8-2598-486a-aff2-ab80d57935b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.879827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540aea8-2598-486a-aff2-ab80d57935b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.880096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540aea8-2598-486a-aff2-ab80d57935b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.880735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540aea8-2598-486a-aff2-ab80d57935b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:45.882388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540aea8-2598-486a-aff2-ab80d57935b5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:45.897863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1108/2233] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:00:45.899260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:45.912043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb243-3c07-45c1-a915-08b9bb5be481 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:45.917627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba889f-9942-49f4-9e8a-36a7f5e9649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:45.920330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba889f-9942-49f4-9e8a-36a7f5e9649e admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:45.920612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba889f-9942-49f4-9e8a-36a7f5e9649e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:45.920885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba889f-9942-49f4-9e8a-36a7f5e9649e admin admin] PATH_INFO: `/v3/projects/14b44238df0443cc8daeb5af93071892/users/22c48028f3814bcaa3b165e783c5355e/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:45.923245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba889f-9942-49f4-9e8a-36a7f5e9649e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b44238df0443cc8daeb5af93071892, user_id=22c48028f3814bcaa3b165e783c5355e, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:45.925875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba889f-9942-49f4-9e8a-36a7f5e9649e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:45.942162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1126/2234] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:00:45 2022] PUT /identity/v3/projects/14b44238df0443cc8daeb5af93071892/users/22c48028f3814bcaa3b165e783c5355e/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:00:50.562679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:50.563167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:50.563473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:50.605895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:50.607489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:50.664650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:50.665573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:50.666010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:50.705608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1109/2235] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:50.709919 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] MFA Rules not processed for user `22c48028f3814bcaa3b165e783c5355e`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:50.711290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:50.732098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:50.733642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:50.840883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:50.859552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1127/2236] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:50.860551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:50.862970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:50.875723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4cdda-5d51-45a7-b39b-7912ca794fbc None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:50.888862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ec613-cc86-46a7-9647-3f306b796e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:50.890154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec613-cc86-46a7-9647-3f306b796e88 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:50.891021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec613-cc86-46a7-9647-3f306b796e88 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:50.891506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec613-cc86-46a7-9647-3f306b796e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:50.903728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ec613-cc86-46a7-9647-3f306b796e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:50.905609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ec613-cc86-46a7-9647-3f306b796e88 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:50.920075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1110/2237] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:50.980465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba8489-3cb5-4370-924e-5abf3c0671f3 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:50.984792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3849cb5e321d48c88f0e19121ec7e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:50.985409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:50.985688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:50.985962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:51.064888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:51.066561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:51.086355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1128/2238] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:00:51.303283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88748ea-4814-41cf-b261-ef9a9daa73c5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:51.303960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88748ea-4814-41cf-b261-ef9a9daa73c5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:51.304478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88748ea-4814-41cf-b261-ef9a9daa73c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:51.331059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c88748ea-4814-41cf-b261-ef9a9daa73c5 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:51.332291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c88748ea-4814-41cf-b261-ef9a9daa73c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:51.344515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:00:51.410747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1111/2239] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:00:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:51.423769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:51.425199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:51.511506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad2190-0460-4cb2-adb5-3b78fc0230a3 service glance] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:51.517632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:51.518397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:51.518731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:51.518952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:51.528275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:51.529883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:51.539909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1129/2240] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:00:54.945587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4274c1-d7ab-457e-b712-438dbb83180d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:54.946163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4274c1-d7ab-457e-b712-438dbb83180d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:54.946163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4274c1-d7ab-457e-b712-438dbb83180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:54.969882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ca4274c1-d7ab-457e-b712-438dbb83180d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:00:54.971097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ca4274c1-d7ab-457e-b712-438dbb83180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:00:54.979946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1112/2241] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:00:55.005810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:00:55.032646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b658b-98b8-4888-9bd1-b9cfb150022f service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:00:55.048683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:00:55.049354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:00:55.049635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:00:55.049897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:00:55.063690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:00:55.065326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:00:55.077269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1130/2242] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:01:00.067432 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025165-76c9-44c5-af7b-57474673ec5e None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:00.068036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025165-76c9-44c5-af7b-57474673ec5e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:00.068315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61025165-76c9-44c5-af7b-57474673ec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:00.096422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-61025165-76c9-44c5-af7b-57474673ec5e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:00.098446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-61025165-76c9-44c5-af7b-57474673ec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:00.111457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1113/2243] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:01:00.137950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:00.158454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3808-46da-4da2-9ae1-2a75a742f943 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:00.166422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:00.167360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:00.167949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:00.168780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:00.179928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:00.182002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:00.197861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1131/2244] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:01:01.150974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77cbb-3c49-42f5-9a67-1a30c806d21f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:01.151494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77cbb-3c49-42f5-9a67-1a30c806d21f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:01.151494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e77cbb-3c49-42f5-9a67-1a30c806d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:01.170928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b3e77cbb-3c49-42f5-9a67-1a30c806d21f None None] MFA Rules not processed for user `ac01b2470edc4224be3eeda9aaf0d57f`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:01.172104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b3e77cbb-3c49-42f5-9a67-1a30c806d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:01.178895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1114/2245] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:01:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:01:02.983013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:02.985539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:03.018230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:03.073174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9185b3f-fcb1-43b5-b1ba-361e1f5ab077 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:03.078666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:03.079201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:03.079476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:03.079741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:03.081706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:03.093560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:03.095155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:03.104932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1132/2246] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:01:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:01:05.310908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d98d-15c8-4c62-8c5f-429fa4ea1d5a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:05.311466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d98d-15c8-4c62-8c5f-429fa4ea1d5a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:05.311466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814d98d-15c8-4c62-8c5f-429fa4ea1d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:05.331347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8814d98d-15c8-4c62-8c5f-429fa4ea1d5a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:05.332544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8814d98d-15c8-4c62-8c5f-429fa4ea1d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:05.340534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1115/2247] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:01:05.365304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:05.379333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2a0b1-17d0-480a-baca-712ee50b442a service placement] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:05.385954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:05.387595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:05.388084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:05.388459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:05.397197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:05.398824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:05.408652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1133/2248] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:01:07.302129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3951-03ee-4a54-991b-ebe47c7c6926 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:07.302722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3951-03ee-4a54-991b-ebe47c7c6926 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:07.302833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3951-03ee-4a54-991b-ebe47c7c6926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:07.329340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-223b3951-03ee-4a54-991b-ebe47c7c6926 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:07.331194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-223b3951-03ee-4a54-991b-ebe47c7c6926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:07.356907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:07.364934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1116/2249] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:01:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:01:07.373936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f648b-5eaa-42e8-a3e2-728faeb0ddf2 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:07.383695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:07.391941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:07.392544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:07.392921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:07.408267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:07.410292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:07.424449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1134/2250] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:01:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 15:01:17.322212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=34 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:17.418253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=36 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:28.157323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277516a-428d-4729-98d6-4d012d3a96d9 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:28.158277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277516a-428d-4729-98d6-4d012d3a96d9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:28.158618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277516a-428d-4729-98d6-4d012d3a96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:28.179955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f277516a-428d-4729-98d6-4d012d3a96d9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:28.181310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f277516a-428d-4729-98d6-4d012d3a96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:28.192107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1117/2251] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:01:28.232804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:28.245084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf1d6d-6495-48fb-9347-6ac292121f4e service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:28.250856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:28.251484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:28.251759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:28.252159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:28.260659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:28.263097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:28.273247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1135/2252] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:01:34.135368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb0efd-3264-474c-986c-f30f3c3be284 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:34.136386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb0efd-3264-474c-986c-f30f3c3be284 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:34.136734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb0efd-3264-474c-986c-f30f3c3be284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:34.164301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7afb0efd-3264-474c-986c-f30f3c3be284 None None] MFA Rules not processed for user `2b2e394413974cd282048e582447aeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:34.165614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7afb0efd-3264-474c-986c-f30f3c3be284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:34.225519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1118/2253] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:01:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:01:38.268579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:44.218325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=28 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:01:50.990197 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:50.992480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:51.089900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339995e-4a17-47b1-a147-e26cd56ad7d3 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:51.094632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349f63b-4542-4e04-95a9-e181d83f0e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:51.095435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f63b-4542-4e04-95a9-e181d83f0e66 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:51.095723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f63b-4542-4e04-95a9-e181d83f0e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:51.095998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349f63b-4542-4e04-95a9-e181d83f0e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:51.108288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f63b-4542-4e04-95a9-e181d83f0e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:51.110060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349f63b-4542-4e04-95a9-e181d83f0e66 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:51.128216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1136/2254] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:01:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:01:53.647773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb0efd-3264-474c-986c-f30f3c3be284 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:53.663314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb0efd-3264-474c-986c-f30f3c3be284 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:53.667548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:53.668272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:53.668650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:53.669110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:53.671048 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:53.749803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:53.751535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:53.763534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1119/2255] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:01:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:01:54.676048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88fa80-3c9b-4747-b3bc-204b0dff6f96 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:54.676544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88fa80-3c9b-4747-b3bc-204b0dff6f96 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:54.676629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88fa80-3c9b-4747-b3bc-204b0dff6f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:54.702709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3e88fa80-3c9b-4747-b3bc-204b0dff6f96 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:54.716322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e88fa80-3c9b-4747-b3bc-204b0dff6f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:54.742925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1137/2256] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:01:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:01:54.758066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:01:54.771566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640d7a-632e-4b11-86f0-83da2aeb76b8 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:01:54.782434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3c7d9-83f1-4396-81e8-06554912f425 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:01:54.783463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c7d9-83f1-4396-81e8-06554912f425 service swift] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:54.783963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c7d9-83f1-4396-81e8-06554912f425 service swift] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:54.784391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3c7d9-83f1-4396-81e8-06554912f425 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:54.796551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3c7d9-83f1-4396-81e8-06554912f425 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:01:54.798475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a3c7d9-83f1-4396-81e8-06554912f425 service swift] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:01:54.809251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1120/2257] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:01:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:01:59.816254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1293e-43f3-4e4d-a3d9-f3dd2690bfcb None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:01:59.816775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1293e-43f3-4e4d-a3d9-f3dd2690bfcb None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:01:59.816775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1293e-43f3-4e4d-a3d9-f3dd2690bfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:01:59.860705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-92d1293e-43f3-4e4d-a3d9-f3dd2690bfcb None None] MFA Rules not processed for user `bb341b18ae9041c2a10177f2a6000513`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:01:59.862127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-92d1293e-43f3-4e4d-a3d9-f3dd2690bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:01:59.943590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1138/2258] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:01:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:04.806643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=36 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:09.933500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=54 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:14.934564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78058df-7885-49f3-868d-87aebecd0993 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:14.935174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78058df-7885-49f3-868d-87aebecd0993 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:14.935174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78058df-7885-49f3-868d-87aebecd0993 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:14.936442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1121/2259] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 15:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 15:02:14.942858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12178-3412-4d9d-ab38-031c3d7f709b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:14.943759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12178-3412-4d9d-ab38-031c3d7f709b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:14.944453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12178-3412-4d9d-ab38-031c3d7f709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:14.968440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fad12178-3412-4d9d-ab38-031c3d7f709b None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:14.969774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fad12178-3412-4d9d-ab38-031c3d7f709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:14.980815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1139/2260] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:14.992668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78058df-7885-49f3-868d-87aebecd0993 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:14.995360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b78058df-7885-49f3-868d-87aebecd0993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:15.010863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78058df-7885-49f3-868d-87aebecd0993 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:15.014589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93fc95-11fd-419f-8a2d-b756d1ea1de7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3849cb5e321d48c88f0e19121ec7e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:15.015197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fc95-11fd-419f-8a2d-b756d1ea1de7 service glance] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:15.015474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fc95-11fd-419f-8a2d-b756d1ea1de7 service glance] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:15.015743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fc95-11fd-419f-8a2d-b756d1ea1de7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:15.027777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93fc95-11fd-419f-8a2d-b756d1ea1de7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:15.029362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93fc95-11fd-419f-8a2d-b756d1ea1de7 service glance] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:15.040687 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1122/2261] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:02:15.113525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718302d7-5b1a-46b2-84c9-9518f8b729f5 None None] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:15.113807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718302d7-5b1a-46b2-84c9-9518f8b729f5 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:15.114077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718302d7-5b1a-46b2-84c9-9518f8b729f5 None None] PATH_INFO: `/` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:15.115450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1140/2262] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 15:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 15:02:15.120587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9461291-328c-48d5-a5fa-167f6344164a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:15.120891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9461291-328c-48d5-a5fa-167f6344164a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:15.121166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9461291-328c-48d5-a5fa-167f6344164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:15.141594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b9461291-328c-48d5-a5fa-167f6344164a None None] MFA Rules not processed for user `b7a92823ec184a86a8ce70ffa1a4424b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:15.142858 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b9461291-328c-48d5-a5fa-167f6344164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:15.149360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1123/2263] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 15:02:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:15.161020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718302d7-5b1a-46b2-84c9-9518f8b729f5 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:15.172308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718302d7-5b1a-46b2-84c9-9518f8b729f5 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:15.175898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e780a91-174a-4d27-b248-e8f79d43c4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:15.176479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e780a91-174a-4d27-b248-e8f79d43c4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:15.176754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e780a91-174a-4d27-b248-e8f79d43c4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:15.177022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e780a91-174a-4d27-b248-e8f79d43c4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:15.184473 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e780a91-174a-4d27-b248-e8f79d43c4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:15.185958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e780a91-174a-4d27-b248-e8f79d43c4a6 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:15.193692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1141/2264] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:02:15.278442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d495a-329b-4b08-b6d2-da7d46958242 None None] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:15.278725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d495a-329b-4b08-b6d2-da7d46958242 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:15.278999 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d495a-329b-4b08-b6d2-da7d46958242 None None] PATH_INFO: `/` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:15.280367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1124/2265] 10.222.0.52 () {54 vars in 921 bytes} [Fri Sep 9 15:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 15:02:15.285479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc00af5-af5d-4b2b-9b4e-1282637ccf8e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:15.285764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc00af5-af5d-4b2b-9b4e-1282637ccf8e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:15.286037 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc00af5-af5d-4b2b-9b4e-1282637ccf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:15.308510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-afc00af5-af5d-4b2b-9b4e-1282637ccf8e None None] MFA Rules not processed for user `8908c33eb701459298d35fa8ccb80bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:15.309716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-afc00af5-af5d-4b2b-9b4e-1282637ccf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:15.319113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1142/2266] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Sep 9 15:02:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:15.329752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d495a-329b-4b08-b6d2-da7d46958242 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:15.340638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d495a-329b-4b08-b6d2-da7d46958242 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:15.344508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:15.345094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:15.345371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:15.345641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:15.356084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:15.357491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:15.368931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1125/2267] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:02:21.156636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162567bf-a306-4568-9344-2d3417c9ad73 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:21.157097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162567bf-a306-4568-9344-2d3417c9ad73 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:21.157211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162567bf-a306-4568-9344-2d3417c9ad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:21.176467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-162567bf-a306-4568-9344-2d3417c9ad73 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:21.177589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-162567bf-a306-4568-9344-2d3417c9ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:21.185445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1143/2268] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:21.197808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:21.209313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109382a2-0a7a-4939-9cd2-d94e7b3d2466 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:21.214348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:21.214935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:21.215206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:21.215480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:21.223247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:21.224810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:21.233274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1126/2269] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:02:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:02:21.825645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0464bb-3af9-4f62-97e6-7ef279df7e9f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:21.825928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0464bb-3af9-4f62-97e6-7ef279df7e9f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:21.826232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0464bb-3af9-4f62-97e6-7ef279df7e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:21.846560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4f0464bb-3af9-4f62-97e6-7ef279df7e9f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:21.847786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4f0464bb-3af9-4f62-97e6-7ef279df7e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:21.856725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1144/2270] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:21.887566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:21.900607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05466a-70e7-4e1c-b153-f26833cddd9e service swift] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:21.906295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:21.906909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:21.907188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:21.907459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:21.916995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:21.918688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:21.928713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1127/2271] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:02:31.841083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=18 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:31.924221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=27 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:02:48.205376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0464bb-3af9-4f62-97e6-7ef279df7e9f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:48.215480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0464bb-3af9-4f62-97e6-7ef279df7e9f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:48.219123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c45c18-c329-4a92-91ad-5a5fe602237b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:48.219709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c45c18-c329-4a92-91ad-5a5fe602237b service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:48.219987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c45c18-c329-4a92-91ad-5a5fe602237b service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:48.220259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c45c18-c329-4a92-91ad-5a5fe602237b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:48.221984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c1c45c18-c329-4a92-91ad-5a5fe602237b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:48.235012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c45c18-c329-4a92-91ad-5a5fe602237b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:48.236432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c45c18-c329-4a92-91ad-5a5fe602237b service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:48.247235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1145/2272] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:02:49.380258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:49.390214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46080be-2794-4c87-b329-824d79182f89 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:49.393851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:49.394474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:49.394753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:49.395021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:49.396803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:49.409995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:49.411601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:49.422243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1128/2273] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:02:49.767048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570168-0148-41ec-be53-7b582d6f7408 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:49.767572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570168-0148-41ec-be53-7b582d6f7408 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:49.767687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a570168-0148-41ec-be53-7b582d6f7408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:49.787785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8a570168-0148-41ec-be53-7b582d6f7408 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:49.788916 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8a570168-0148-41ec-be53-7b582d6f7408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:49.797506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1146/2274] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:49.818136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:49.829811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927859b-3ec9-4100-a6bf-ac1e176debce service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:49.835224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:49.835811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:49.836088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:49.836359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:49.844624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:49.846288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:49.856060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1129/2275] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:02:52.807118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698480d-5e91-4346-ad7e-b217588df41b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:52.807650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698480d-5e91-4346-ad7e-b217588df41b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:52.807957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698480d-5e91-4346-ad7e-b217588df41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:52.847525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-f698480d-5e91-4346-ad7e-b217588df41b None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:52.850480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f698480d-5e91-4346-ad7e-b217588df41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:52.861072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1147/2276] 10.222.0.52 () {58 vars in 967 bytes} [Fri Sep 9 15:02:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:52.874707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:52.886869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750dea4-1be4-4abe-af66-9446e41d9be2 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:52.892799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:52.893505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:52.893857 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:52.894228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:52.903402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:52.905681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:52.914176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1130/2277] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:02:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:02:54.915800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408664d4-9ad1-4276-9a80-d2bcd4dfc2a3 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:54.916303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408664d4-9ad1-4276-9a80-d2bcd4dfc2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:54.916417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408664d4-9ad1-4276-9a80-d2bcd4dfc2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:54.936132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-408664d4-9ad1-4276-9a80-d2bcd4dfc2a3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:54.937315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-408664d4-9ad1-4276-9a80-d2bcd4dfc2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:54.945097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1148/2278] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:54.978491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:54.990481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec501a8b-1800-4038-a7ab-35a692ff10cc service swift] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:54.995888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:54.996473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:54.996752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:54.997023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:55.005501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:55.007105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:55.016886 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1131/2279] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:02:59.113416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75936376-24c3-4297-a389-067aad18febd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:59.114019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75936376-24c3-4297-a389-067aad18febd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:59.114019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75936376-24c3-4297-a389-067aad18febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:59.133793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-75936376-24c3-4297-a389-067aad18febd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:02:59.135010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-75936376-24c3-4297-a389-067aad18febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:02:59.142849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1149/2280] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:02:59.165426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:02:59.177288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919f2e6-220d-41e5-b34d-d0c47a046340 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:02:59.182757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:02:59.183280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:02:59.183553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:02:59.183819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:02:59.192776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:02:59.194365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:02:59.203971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1132/2281] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:03:03.321557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81816-6be5-4f7b-bab0-1d82aeeb9580 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:03.321964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81816-6be5-4f7b-bab0-1d82aeeb9580 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:03.322121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f81816-6be5-4f7b-bab0-1d82aeeb9580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:03.342076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-b3f81816-6be5-4f7b-bab0-1d82aeeb9580 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:03:03.343288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-b3f81816-6be5-4f7b-bab0-1d82aeeb9580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:03.351683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1150/2282] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Sep 9 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:03:03.373393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:03.384225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a995d1-d5b0-4b69-bcf5-664ce46938d6 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:03.389634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fdee2-a228-4623-8e61-3b27be8a4358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:03.390254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fdee2-a228-4623-8e61-3b27be8a4358 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:03.390535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fdee2-a228-4623-8e61-3b27be8a4358 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:03.391415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fdee2-a228-4623-8e61-3b27be8a4358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:03.399488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fdee2-a228-4623-8e61-3b27be8a4358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:03.401064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fdee2-a228-4623-8e61-3b27be8a4358 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:03.411394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1133/2283] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:03:04.719647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81816-6be5-4f7b-bab0-1d82aeeb9580 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:04.732118 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f81816-6be5-4f7b-bab0-1d82aeeb9580 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:04.737677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:04.738291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:04.738571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:04.738842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:04.740526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:04.798263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:04.799851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:04.808694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1151/2284] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:03:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:03:13.406465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=36 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:14.804594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=49 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:21.412284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390445f-b1a1-4067-8d09-b7c3931f92f3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:21.412782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390445f-b1a1-4067-8d09-b7c3931f92f3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:21.412880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390445f-b1a1-4067-8d09-b7c3931f92f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:21.431928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7390445f-b1a1-4067-8d09-b7c3931f92f3 None None] MFA Rules not processed for user `507a05e50d1345d498bb0f06fe4ef2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:03:21.433126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7390445f-b1a1-4067-8d09-b7c3931f92f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:21.440181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1134/2285] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:03:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:03:21.718569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:21.728161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e6466-9139-4141-8520-fa9971d4acda service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:21.731835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:21.732436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:21.732715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:21.732982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:21.734684 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:21.745245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:21.746697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:21.755483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1152/2286] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:03:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:03:25.776746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390445f-b1a1-4067-8d09-b7c3931f92f3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:25.790106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390445f-b1a1-4067-8d09-b7c3931f92f3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:25.795753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:25.796383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:25.796665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:25.796938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:25.798729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:25.855996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:25.857586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:25.866903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1135/2287] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:03:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:03:31.751235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:35.862716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=31 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:37.800431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:37.802021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:37.816275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da92af-55ae-4c6f-ac83-d28c84647679 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:37.822009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:37.822650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:37.822924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:37.823194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] PATH_INFO: `/v3/users/bb341b18ae9041c2a10177f2a6000513` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:37.824430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb341b18ae9041c2a10177f2a6000513)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:37.826352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:37.878643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb341b18ae9041c2a10177f2a6000513'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:37.887626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb341b18ae9041c2a10177f2a6000513'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:37.902410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb341b18ae9041c2a10177f2a6000513'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:37.903095 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb341b18ae9041c2a10177f2a6000513'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:37.910210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb341b18ae9041c2a10177f2a6000513'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:37.916625 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1153/2288] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:03:37 2022] DELETE /identity/v3/users/bb341b18ae9041c2a10177f2a6000513 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:03:38.092727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:38.106250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da37288-ce28-4982-93ac-22746863ae91 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:38.167125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:38.167807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:38.168237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:38.168691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] PATH_INFO: `/v3/projects/0f0ad164d987410b9f86823fb6efd65a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:38.169799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0ad164d987410b9f86823fb6efd65a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:38.171726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:38.221640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0ad164d987410b9f86823fb6efd65a', 'request_id': 'req-f05f4183-35a7-45b9-bfa7-b472965d6b28'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:38.231320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0ad164d987410b9f86823fb6efd65a', 'request_id': 'req-f05f4183-35a7-45b9-bfa7-b472965d6b28'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:38.237552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0ad164d987410b9f86823fb6efd65a', 'request_id': 'req-f05f4183-35a7-45b9-bfa7-b472965d6b28'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:38.248089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] The token cache is being invalidate because project 0f0ad164d987410b9f86823fb6efd65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:03:38.248378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:38.249032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:03:38.250575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1136/2289] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:03:38 2022] DELETE /identity/v3/projects/0f0ad164d987410b9f86823fb6efd65a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:03:47.913169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:48.244989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:03:53.773165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:53.774626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:53.847206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20569a2-903a-4c1d-a24d-7983cf832c6d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:53.909055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9384dfc-11c3-4b06-9600-9ddc961369e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:53.909877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9384dfc-11c3-4b06-9600-9ddc961369e2 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:53.910193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9384dfc-11c3-4b06-9600-9ddc961369e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:53.911193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9384dfc-11c3-4b06-9600-9ddc961369e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:53.912939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a9384dfc-11c3-4b06-9600-9ddc961369e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:53.971360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9384dfc-11c3-4b06-9600-9ddc961369e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:53.973461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9384dfc-11c3-4b06-9600-9ddc961369e2 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:53.982466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1154/2290] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:03:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:03:57.272122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:03:57.273861 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:57.290948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4183-35a7-45b9-bfa7-b472965d6b28 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:03:57.297597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:03:57.298276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:03:57.298626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:03:57.298915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:03:57.300781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:03:57.313748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:03:57.315415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:03:57.327411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1137/2291] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:03:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:04:03.978289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=84 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:07.322609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=6 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:07.699804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:07.700319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:07.700319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:07.719619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] MFA Rules not processed for user `2b2e394413974cd282048e582447aeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:04:07.720804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:07.728395 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1155/2292] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:04:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:04:08.030807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:04:08.032249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:08.088786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ab556-2209-4c8b-80fd-24265d10b421 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:04:08.092388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:04:08.092981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:08.093254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:08.093518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:08.095248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:08.105279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:04:08.106713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:04:08.114634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1138/2293] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:04:08.423065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:04:08.424537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:08.496110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb0825-ab64-4cc0-ab01-2564c922e7ee None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:04:08.501079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:04:08.501674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:08.501948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:08.502256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:08.504746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:08.515708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:04:08.517255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:04:08.527781 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1156/2294] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:04:10.985816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:04:10.987450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:11.004503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51b77-08a3-45a9-aba5-5c80ce88df87 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:04:11.010236 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d02d-0dc2-493c-91bd-157d23819b99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:04:11.010840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d02d-0dc2-493c-91bd-157d23819b99 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:11.011121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d02d-0dc2-493c-91bd-157d23819b99 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:11.011396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d02d-0dc2-493c-91bd-157d23819b99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:11.013144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ac15d02d-0dc2-493c-91bd-157d23819b99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:11.076681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15d02d-0dc2-493c-91bd-157d23819b99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:04:11.078340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15d02d-0dc2-493c-91bd-157d23819b99 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:04:11.088561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1139/2295] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:04:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:04:18.523829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=35 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:19.942465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:04:19.957398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52c76a-3d0c-44e5-adbf-d5762866c4f4 service placement] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:04:19.963170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:04:19.963828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:19.964110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:19.964381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:19.966174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:19.979622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:04:19.981078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:04:19.993918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1157/2296] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:04:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:04:21.084156 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=54 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:22.864660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ebed-c1ce-461d-ade3-749500b23504 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:22.865305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ebed-c1ce-461d-ade3-749500b23504 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:22.865305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29ebed-c1ce-461d-ade3-749500b23504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:22.885267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3a29ebed-c1ce-461d-ade3-749500b23504 None None] MFA Rules not processed for user `4bcd5d323ed6428d92b299218e900d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:04:22.886513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3a29ebed-c1ce-461d-ade3-749500b23504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:22.893640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1140/2297] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:04:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:04:23.950201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:04:23.962028 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219fb17-ff17-424c-8afc-dedd2cb08d46 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:04:23.967740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:04:23.968346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:23.968637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:23.969337 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:23.970682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:23.984170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:04:23.985853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:04:23.998526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1158/2298] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:04:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:04:32.879559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:33.993396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=12 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:04:56.714292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3bd91-d212-4f04-9ca7-5335799d7633 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:04:56.714827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3bd91-d212-4f04-9ca7-5335799d7633 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:04:56.714827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3bd91-d212-4f04-9ca7-5335799d7633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:04:56.733819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-5bb3bd91-d212-4f04-9ca7-5335799d7633 None None] MFA Rules not processed for user `b12eee6f7bee44c6a2cb31de030e0e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:04:56.735040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5bb3bd91-d212-4f04-9ca7-5335799d7633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:04:56.789284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1141/2299] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:04:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:00.001138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:00.010855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7ea9-e7dc-4eb2-b35b-df00368fd7e5 service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:00.014382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:00.014962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:00.015238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:00.015506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:00.017341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:00.080158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:00.081575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:00.091273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1159/2300] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:04.609142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7c37-051e-4327-8d03-b9451919841b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:04.610307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7c37-051e-4327-8d03-b9451919841b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:04.610803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7c37-051e-4327-8d03-b9451919841b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:04.638044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-75fb7c37-051e-4327-8d03-b9451919841b None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:04.639866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-75fb7c37-051e-4327-8d03-b9451919841b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:04.742332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1142/2301] 10.222.0.52 () {58 vars in 967 bytes} [Fri Sep 9 15:05:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:04.806739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:04.808328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:04.841468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7c37-051e-4327-8d03-b9451919841b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:04.862352 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7c37-051e-4327-8d03-b9451919841b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:04.868384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:04.869009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:04.869290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:04.869566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:04.871798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:04.886598 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:04.888285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:04.912757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1143/2302] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:04.928016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:04.930353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:04.950736 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556c69-1584-41a9-87a6-205671e25b42 service placement] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:04.957894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d6002-5f9d-4bcf-8252-45c8d7b8df50 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:04.958184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:04.958670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:04.958953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:04.959230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] PATH_INFO: `/v3/users/507a05e50d1345d498bb0f06fe4ef2df` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:04.960854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507a05e50d1345d498bb0f06fe4ef2df)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:04.963207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:04.969524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:04.970273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:04.970560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:04.971016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:04.982196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:04.983377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:04.993461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1160/2303] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:05:05.024184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507a05e50d1345d498bb0f06fe4ef2df'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.032615 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507a05e50d1345d498bb0f06fe4ef2df'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.033344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507a05e50d1345d498bb0f06fe4ef2df'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.041121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507a05e50d1345d498bb0f06fe4ef2df'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.055970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-cdcfe9e5-d65f-4d6a-96a6-46fcdfdc3333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507a05e50d1345d498bb0f06fe4ef2df'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.063572 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1144/2304] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:04 2022] DELETE /identity/v3/users/507a05e50d1345d498bb0f06fe4ef2df => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:05.455961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:05.468913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03448a52-0bc7-4973-a2b5-0645d715e420 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:05.581352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:05.583122 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:05.583411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:05.583907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] PATH_INFO: `/v3/projects/7bffc60229a14ecfa5ef5698300ccd7c` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:05.585149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bffc60229a14ecfa5ef5698300ccd7c)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:05.587300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:05.623299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:05.648049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bffc60229a14ecfa5ef5698300ccd7c', 'request_id': 'req-c6993199-12ab-4404-9c49-d0d66d6e681a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.655872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bffc60229a14ecfa5ef5698300ccd7c', 'request_id': 'req-c6993199-12ab-4404-9c49-d0d66d6e681a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.665176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bffc60229a14ecfa5ef5698300ccd7c', 'request_id': 'req-c6993199-12ab-4404-9c49-d0d66d6e681a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.682562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] The token cache is being invalidate because project 7bffc60229a14ecfa5ef5698300ccd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:05.682871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.688158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c6993199-12ab-4404-9c49-d0d66d6e681a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:05.706796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1161/2305] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:05 2022] DELETE /identity/v3/projects/7bffc60229a14ecfa5ef5698300ccd7c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:05.708950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdae09-817a-471b-b61e-5be093d5eff5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:05.709402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdae09-817a-471b-b61e-5be093d5eff5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:05.709504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdae09-817a-471b-b61e-5be093d5eff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:05.729310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-c4cdae09-817a-471b-b61e-5be093d5eff5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:05.730550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c4cdae09-817a-471b-b61e-5be093d5eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:05.734790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:05.802519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1145/2306] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:05.810058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e22e5d-9f7f-4174-9b50-c364b8fa35dd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:05.810597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e22e5d-9f7f-4174-9b50-c364b8fa35dd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:05.810705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e22e5d-9f7f-4174-9b50-c364b8fa35dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:05.839173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-56e22e5d-9f7f-4174-9b50-c364b8fa35dd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:05.840480 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-56e22e5d-9f7f-4174-9b50-c364b8fa35dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:05.849299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1162/2307] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:05.853585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdae09-817a-471b-b61e-5be093d5eff5 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:05.863999 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdae09-817a-471b-b61e-5be093d5eff5 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:05.868619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:05.869229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:05.869508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:05.869780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:05.870462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:05:05.870770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:05.872377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:05.885168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1146/2308] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:05:05.889503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e22e5d-9f7f-4174-9b50-c364b8fa35dd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:05.899189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e22e5d-9f7f-4174-9b50-c364b8fa35dd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:05.903960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:05.904556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:05.904835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:05.905108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:05.905781 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:05.907730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:05.936662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1163/2309] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:05 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:05:05.940768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:05.951599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b0b5e-cbd7-41f9-8053-b671b2dd130c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.014113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.014725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.015012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.015283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.015909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.017812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.040776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1147/2310] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:05 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:06.045124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.057075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ba245-5f0b-406d-b00a-d54961776493 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.061640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.062276 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.062554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.062824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.063463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.065064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.076658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1164/2311] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:06.080419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.093595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15207390-7c00-4f8d-89fd-70f080c0d633 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.100114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd541a-3aa2-40c4-95dc-6047c134a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.100114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd541a-3aa2-40c4-95dc-6047c134a761 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.100114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd541a-3aa2-40c4-95dc-6047c134a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.100467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd541a-3aa2-40c4-95dc-6047c134a761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.100785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd541a-3aa2-40c4-95dc-6047c134a761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.102395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd541a-3aa2-40c4-95dc-6047c134a761 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.116843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1148/2312] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:05:06.119059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.129273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007631-08ae-4a65-9668-788e509cf112 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.134112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.134790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.135071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.135346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] PATH_INFO: `/v3/projects/2496a48905f34479b6c6337cd8f8092e/users/6970cfdbf0bd453cb1d7d2de279b2b07/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.150820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2496a48905f34479b6c6337cd8f8092e, user_id=6970cfdbf0bd453cb1d7d2de279b2b07, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.154023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.172595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1165/2313] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:06 2022] PUT /identity/v3/projects/2496a48905f34479b6c6337cd8f8092e/users/6970cfdbf0bd453cb1d7d2de279b2b07/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:06.184798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c27e6-8bb9-48c3-b169-818b440a38a7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.185101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c27e6-8bb9-48c3-b169-818b440a38a7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.185371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c27e6-8bb9-48c3-b169-818b440a38a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.214956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-951c27e6-8bb9-48c3-b169-818b440a38a7 None None] MFA Rules not processed for user `6970cfdbf0bd453cb1d7d2de279b2b07`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:06.216169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-951c27e6-8bb9-48c3-b169-818b440a38a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:06.284466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1149/2314] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:05:06.289818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.352571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7f514-5efb-4c86-bccc-a695817c4bbf admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.357344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.357950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.358577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.358851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.359476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.361812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.391362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1166/2315] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:06 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:06.396053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c27e6-8bb9-48c3-b169-818b440a38a7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.403779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:06.408539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c27e6-8bb9-48c3-b169-818b440a38a7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.469738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.470379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.470648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.470990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.471821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.474253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.510153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1150/2316] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:06 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:06.512291 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.523616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2990cdb-3914-49dc-bcce-41633288f34d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.528786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.529403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.529682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.529955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.530641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.532279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.545172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1167/2317] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:06.549500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.562272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182328-47e2-4064-9e0a-0ed42af41752 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.568433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.569157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.569440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.569713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] PATH_INFO: `/v3/projects/9885ecd28b6e4f4b9b7dc3036e8f5f2f/users/65839bd0fa324bbba61b347e038b4758/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.586864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9885ecd28b6e4f4b9b7dc3036e8f5f2f, user_id=65839bd0fa324bbba61b347e038b4758, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.589631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.610468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1151/2318] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:06 2022] PUT /identity/v3/projects/9885ecd28b6e4f4b9b7dc3036e8f5f2f/users/65839bd0fa324bbba61b347e038b4758/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:05:06.611617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.624930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3fe2f-0a48-4649-85e2-e6266585750e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.667143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:06.716227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb7ae-9b4c-4b9e-9e7e-096d98e84b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.717134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb7ae-9b4c-4b9e-9e7e-096d98e84b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.717722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb7ae-9b4c-4b9e-9e7e-096d98e84b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.718542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb7ae-9b4c-4b9e-9e7e-096d98e84b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.718542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfb7ae-9b4c-4b9e-9e7e-096d98e84b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.720331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfb7ae-9b4c-4b9e-9e7e-096d98e84b17 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.732129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1168/2319] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:05:06.736828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.752474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cad3-3566-49f5-9b74-c812ca1f7719 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.758223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.758884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.759244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.759622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] PATH_INFO: `/v3/projects/9885ecd28b6e4f4b9b7dc3036e8f5f2f/users/65839bd0fa324bbba61b347e038b4758/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.761536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9885ecd28b6e4f4b9b7dc3036e8f5f2f, user_id=65839bd0fa324bbba61b347e038b4758, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.764201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:06.776785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1152/2320] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:06 2022] PUT /identity/v3/projects/9885ecd28b6e4f4b9b7dc3036e8f5f2f/users/65839bd0fa324bbba61b347e038b4758/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:06.787736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514825e2-46b8-48b2-9434-3db498f8a349 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.788013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514825e2-46b8-48b2-9434-3db498f8a349 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.788285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514825e2-46b8-48b2-9434-3db498f8a349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.817827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-514825e2-46b8-48b2-9434-3db498f8a349 None None] MFA Rules not processed for user `65839bd0fa324bbba61b347e038b4758`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:06.819282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-514825e2-46b8-48b2-9434-3db498f8a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:06.898121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1169/2321] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:05:06.911912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:06.913611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:06.976429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74682809-accb-4180-8f25-4900cd0055b3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:06.980343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d223e-db0c-4330-bb83-5ac9ba0dd0fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:06.980942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d223e-db0c-4330-bb83-5ac9ba0dd0fb service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:06.981221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d223e-db0c-4330-bb83-5ac9ba0dd0fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:06.981487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d223e-db0c-4330-bb83-5ac9ba0dd0fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:06.991379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d223e-db0c-4330-bb83-5ac9ba0dd0fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:06.992825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d223e-db0c-4330-bb83-5ac9ba0dd0fb service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:07.002705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1153/2322] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:07.503599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514825e2-46b8-48b2-9434-3db498f8a349 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:07.575088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514825e2-46b8-48b2-9434-3db498f8a349 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:07.580040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:07.580650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:07.581081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:07.581364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] PATH_INFO: `/v3/users/6970cfdbf0bd453cb1d7d2de279b2b07` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:07.582704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] RBAC: Authorizing `identity:delete_user(user_id=6970cfdbf0bd453cb1d7d2de279b2b07)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:07.584719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:07.638974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6970cfdbf0bd453cb1d7d2de279b2b07'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:07.642229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:07.649365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6970cfdbf0bd453cb1d7d2de279b2b07'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:07.664655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6970cfdbf0bd453cb1d7d2de279b2b07'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:07.665467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6970cfdbf0bd453cb1d7d2de279b2b07'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:07.673616 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6970cfdbf0bd453cb1d7d2de279b2b07'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:07.683590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1170/2323] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:07 2022] DELETE /identity/v3/users/6970cfdbf0bd453cb1d7d2de279b2b07 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:07.685621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:07.685916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:07.686224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:07.705454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:07.706698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:07.772327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:07.783757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1154/2324] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:07.793939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:07.795534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:07.861495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72931c87-a9fa-4f56-ba67-624538e989de admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:07.866175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:07.866681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:07.866967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:07.867239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:07.876803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:07.878269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:07.889091 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1171/2325] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:05:08.408107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:08.411539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:08.440978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bfc02-1ab3-468d-9e8e-1a6d7f0eb99f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:08.446355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:08.447067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:08.447435 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:08.447777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] PATH_INFO: `/v3/projects/2496a48905f34479b6c6337cd8f8092e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:08.449293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2496a48905f34479b6c6337cd8f8092e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:08.451575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:08.515121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2496a48905f34479b6c6337cd8f8092e', 'request_id': 'req-0b1b17af-446f-4680-a9bd-98ed6975838b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.522789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2496a48905f34479b6c6337cd8f8092e', 'request_id': 'req-0b1b17af-446f-4680-a9bd-98ed6975838b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.529525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2496a48905f34479b6c6337cd8f8092e', 'request_id': 'req-0b1b17af-446f-4680-a9bd-98ed6975838b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.545952 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] The token cache is being invalidate because project 2496a48905f34479b6c6337cd8f8092e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:08.547180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.548331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.550589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1155/2326] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:08 2022] DELETE /identity/v3/projects/2496a48905f34479b6c6337cd8f8092e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:08.554839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:08.569044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddef9e8-2fa3-49d9-b542-8d00725f31b3 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:08.675761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:08.677832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:08.678129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:08.678403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] PATH_INFO: `/v3/users/65839bd0fa324bbba61b347e038b4758` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:08.681097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65839bd0fa324bbba61b347e038b4758)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:08.686117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:08.775701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65839bd0fa324bbba61b347e038b4758'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.791302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65839bd0fa324bbba61b347e038b4758'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.808084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:08.810588 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65839bd0fa324bbba61b347e038b4758'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.811564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65839bd0fa324bbba61b347e038b4758'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.827280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-34f49e55-9459-4eff-9da7-7f9dbe278689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65839bd0fa324bbba61b347e038b4758'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:08.838294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1172/2327] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:08 2022] DELETE /identity/v3/users/65839bd0fa324bbba61b347e038b4758 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:09.657050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:09.659562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:09.674971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b17af-446f-4680-a9bd-98ed6975838b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:09.773302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:09.773949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:09.774257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:09.774573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] PATH_INFO: `/v3/projects/9885ecd28b6e4f4b9b7dc3036e8f5f2f` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:09.776506 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9885ecd28b6e4f4b9b7dc3036e8f5f2f)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:09.778514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:09.827078 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9885ecd28b6e4f4b9b7dc3036e8f5f2f', 'request_id': 'req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:09.834665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9885ecd28b6e4f4b9b7dc3036e8f5f2f', 'request_id': 'req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:09.842133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9885ecd28b6e4f4b9b7dc3036e8f5f2f', 'request_id': 'req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:09.855013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] The token cache is being invalidate because project 9885ecd28b6e4f4b9b7dc3036e8f5f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:09.855410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:09.856372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a27f36bc-c48f-49e7-abc5-c9bdd202fae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:09.858362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1156/2328] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:09 2022] DELETE /identity/v3/projects/9885ecd28b6e4f4b9b7dc3036e8f5f2f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:09.863320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384c13-b83c-475b-8d52-cec8786bcab9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:09.864403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384c13-b83c-475b-8d52-cec8786bcab9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:09.864641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384c13-b83c-475b-8d52-cec8786bcab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:09.887583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-01384c13-b83c-475b-8d52-cec8786bcab9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:09.889263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-01384c13-b83c-475b-8d52-cec8786bcab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:09.960805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1173/2329] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:09.968531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a7f0-7c3e-45d5-aa15-37fd8ce7b3d7 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:09.968818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a7f0-7c3e-45d5-aa15-37fd8ce7b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:09.969092 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454a7f0-7c3e-45d5-aa15-37fd8ce7b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:09.991776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b454a7f0-7c3e-45d5-aa15-37fd8ce7b3d7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:09.993234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b454a7f0-7c3e-45d5-aa15-37fd8ce7b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:10.001500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1157/2330] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:10.006382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384c13-b83c-475b-8d52-cec8786bcab9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.016013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384c13-b83c-475b-8d52-cec8786bcab9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.021443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.022154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.022441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.022715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.023365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:05:10.023671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.025334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.037141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1174/2331] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:05:10.041391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454a7f0-7c3e-45d5-aa15-37fd8ce7b3d7 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.051214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454a7f0-7c3e-45d5-aa15-37fd8ce7b3d7 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.056126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.056724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.057004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.057304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.057941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.059899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.064564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:10.090626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1158/2332] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:10 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:05:10.094756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.104933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef131d7-51a5-4316-abb7-e355002142c9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.163920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.164526 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.164826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.165074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.165698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.167661 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.189808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1175/2333] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:10 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:10.194235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.204813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82462c-ce5e-4179-8d71-b1571e491e84 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.210012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.210762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.211101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.211321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.211961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.213591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.227109 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1159/2334] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:10.228599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.238878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f068df-db77-4091-8534-c3cc1e76e71a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.243589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08165ade-6b39-4387-a64e-0878e8a1344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.244186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165ade-6b39-4387-a64e-0878e8a1344c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.244467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165ade-6b39-4387-a64e-0878e8a1344c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.244742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165ade-6b39-4387-a64e-0878e8a1344c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.245378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08165ade-6b39-4387-a64e-0878e8a1344c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.247008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08165ade-6b39-4387-a64e-0878e8a1344c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.257699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1176/2335] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:10.262158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.274551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0145a-6f46-4073-be38-d7cc323589de admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.279880 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.280610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.280896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.281172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] PATH_INFO: `/v3/projects/a4771716c0fc40fea0ca60ec6efe8e46/users/00d4f6768de84d77afb65737572290d4/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.296712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4771716c0fc40fea0ca60ec6efe8e46, user_id=00d4f6768de84d77afb65737572290d4, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.299277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.312652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1160/2336] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:10 2022] PUT /identity/v3/projects/a4771716c0fc40fea0ca60ec6efe8e46/users/00d4f6768de84d77afb65737572290d4/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:10.324637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c6cd9-4fc4-4b8f-8603-123230238b3e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.325004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c6cd9-4fc4-4b8f-8603-123230238b3e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.325606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c6cd9-4fc4-4b8f-8603-123230238b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.355114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-308c6cd9-4fc4-4b8f-8603-123230238b3e None None] MFA Rules not processed for user `00d4f6768de84d77afb65737572290d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:10.356414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-308c6cd9-4fc4-4b8f-8603-123230238b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:10.399845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:10.424378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1177/2337] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:10.430042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.491477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe84179-971b-4a5f-a420-27694bc1ea69 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.496177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.496783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.497061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.497332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.497957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.499884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.527044 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1161/2338] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:10 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:10.531097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c6cd9-4fc4-4b8f-8603-123230238b3e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.542200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c6cd9-4fc4-4b8f-8603-123230238b3e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.599751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.600520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.600795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.601062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.601690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.603646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.628028 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1178/2339] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:10 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:10.629289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.639729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576dc7b-f6d4-4c20-a933-c1741de003c5 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.644358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.645029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.645305 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.645576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.646254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.647846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.662487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1162/2340] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:05:10.663764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.674553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00760bc6-6141-4fca-9829-1643ec844b86 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.680010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.680668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.680948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.681219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] PATH_INFO: `/v3/projects/f33168d0a0d84ef8b28a4e51d72c54e2/users/89304a5558d74291877a98a69f43bb79/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.706015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33168d0a0d84ef8b28a4e51d72c54e2, user_id=89304a5558d74291877a98a69f43bb79, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.709313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.729038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1179/2341] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:10 2022] PUT /identity/v3/projects/f33168d0a0d84ef8b28a4e51d72c54e2/users/89304a5558d74291877a98a69f43bb79/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:05:10.733367 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.752407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb229c-65e5-420b-8d2e-a245bc65d94e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.882002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af55ee2-88d2-4779-a522-47ed57a050e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.882752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55ee2-88d2-4779-a522-47ed57a050e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.883096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55ee2-88d2-4779-a522-47ed57a050e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.883440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af55ee2-88d2-4779-a522-47ed57a050e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.884163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af55ee2-88d2-4779-a522-47ed57a050e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.885995 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af55ee2-88d2-4779-a522-47ed57a050e5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.904224 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1163/2342] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:10.905160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:10.918380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39775c-be87-45f9-8256-a3659670a274 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:10.927229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:10.928205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.929130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.929607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] PATH_INFO: `/v3/projects/f33168d0a0d84ef8b28a4e51d72c54e2/users/89304a5558d74291877a98a69f43bb79/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:10.931895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33168d0a0d84ef8b28a4e51d72c54e2, user_id=89304a5558d74291877a98a69f43bb79, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:10.934837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:10.959008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1180/2343] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:10 2022] PUT /identity/v3/projects/f33168d0a0d84ef8b28a4e51d72c54e2/users/89304a5558d74291877a98a69f43bb79/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:10.969756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42b72-7017-449e-a07e-f14ab67e2df8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:10.970128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42b72-7017-449e-a07e-f14ab67e2df8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:10.970510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42b72-7017-449e-a07e-f14ab67e2df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:11.041102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d0b42b72-7017-449e-a07e-f14ab67e2df8 None None] MFA Rules not processed for user `89304a5558d74291877a98a69f43bb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:11.051303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d0b42b72-7017-449e-a07e-f14ab67e2df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:11.061480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:11.147038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1164/2344] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:11.164798 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:11.167634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:11.241720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eee6a8-ae35-4782-b203-1bd380cf37e0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:11.245479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ba78e-2feb-4357-a5c0-2c7b3b3083f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:11.246275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba78e-2feb-4357-a5c0-2c7b3b3083f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:11.246572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba78e-2feb-4357-a5c0-2c7b3b3083f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:11.246960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ba78e-2feb-4357-a5c0-2c7b3b3083f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:11.257138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ba78e-2feb-4357-a5c0-2c7b3b3083f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:11.258783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ba78e-2feb-4357-a5c0-2c7b3b3083f1 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:11.270043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1181/2345] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:11.305998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42b72-7017-449e-a07e-f14ab67e2df8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:11.386073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42b72-7017-449e-a07e-f14ab67e2df8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:11.391499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196981e1-5049-416a-921b-57f633592173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:11.392301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196981e1-5049-416a-921b-57f633592173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:11.392703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196981e1-5049-416a-921b-57f633592173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:11.392977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196981e1-5049-416a-921b-57f633592173 admin admin] PATH_INFO: `/v3/users/00d4f6768de84d77afb65737572290d4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:11.394153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196981e1-5049-416a-921b-57f633592173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d4f6768de84d77afb65737572290d4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:11.396217 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196981e1-5049-416a-921b-57f633592173 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:11.487023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d4f6768de84d77afb65737572290d4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:11.496457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d4f6768de84d77afb65737572290d4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:11.497706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d4f6768de84d77afb65737572290d4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:11.506499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d4f6768de84d77afb65737572290d4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:11.522716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d4f6768de84d77afb65737572290d4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:11.532650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1165/2346] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:11 2022] DELETE /identity/v3/users/00d4f6768de84d77afb65737572290d4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:11.534372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:11.534660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:11.534930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:11.555012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:11.556238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:11.593925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:11.631427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1182/2347] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:11.638077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:11.639710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:11.669875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:11.713556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196981e1-5049-416a-921b-57f633592173 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:11.718684 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:11.719476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:11.719856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:11.720227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:11.730851 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:11.732483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:11.744487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1166/2348] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:12.474950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:12.476506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:12.535818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212083-67c3-4869-871d-ca8bccb1e61a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:12.543164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:12.543937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:12.544315 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:12.544682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] PATH_INFO: `/v3/projects/a4771716c0fc40fea0ca60ec6efe8e46` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:12.546116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4771716c0fc40fea0ca60ec6efe8e46)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:12.548338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:12.620813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4771716c0fc40fea0ca60ec6efe8e46', 'request_id': 'req-c48775f4-59ee-413c-9862-87e0e154d34a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.627988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4771716c0fc40fea0ca60ec6efe8e46', 'request_id': 'req-c48775f4-59ee-413c-9862-87e0e154d34a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.635405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4771716c0fc40fea0ca60ec6efe8e46', 'request_id': 'req-c48775f4-59ee-413c-9862-87e0e154d34a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.652897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] The token cache is being invalidate because project a4771716c0fc40fea0ca60ec6efe8e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:12.653193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.653668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:12.653940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.655280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:12.655973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1183/2349] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:12 2022] DELETE /identity/v3/projects/a4771716c0fc40fea0ca60ec6efe8e46 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:05:12.661750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:12.663210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:12.670628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039fea3-c042-4560-b20d-639dd5e90714 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:12.750599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:12.751476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:12.752313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:12.752715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48775f4-59ee-413c-9862-87e0e154d34a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:12.752863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:12.755038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:12.757789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:12.759087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:12.759087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:12.760398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] PATH_INFO: `/v3/users/89304a5558d74291877a98a69f43bb79` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:12.761557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=89304a5558d74291877a98a69f43bb79)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:12.764783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:12.766956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:12.768399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:12.778873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1167/2350] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:12.833015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89304a5558d74291877a98a69f43bb79'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.851852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89304a5558d74291877a98a69f43bb79'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.860681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:12.870314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89304a5558d74291877a98a69f43bb79'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.871401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89304a5558d74291877a98a69f43bb79'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.884796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-63abc1ee-426c-4b19-962d-eeed12248cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89304a5558d74291877a98a69f43bb79'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:12.896603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1184/2351] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:12 2022] DELETE /identity/v3/users/89304a5558d74291877a98a69f43bb79 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:13.759946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:13.775038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c272fb-fa60-43e6-a2e1-4adafc9dc2e2 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:13.900916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:13.902464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:13.903022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:13.903617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] PATH_INFO: `/v3/projects/f33168d0a0d84ef8b28a4e51d72c54e2` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:13.905025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33168d0a0d84ef8b28a4e51d72c54e2)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:13.907480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:13.991784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33168d0a0d84ef8b28a4e51d72c54e2', 'request_id': 'req-33bfa39d-a800-427d-901c-02732f84f33b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.021639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33168d0a0d84ef8b28a4e51d72c54e2', 'request_id': 'req-33bfa39d-a800-427d-901c-02732f84f33b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.032877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33168d0a0d84ef8b28a4e51d72c54e2', 'request_id': 'req-33bfa39d-a800-427d-901c-02732f84f33b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.049100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:14.060338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] The token cache is being invalidate because project f33168d0a0d84ef8b28a4e51d72c54e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:14.060811 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.061624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-33bfa39d-a800-427d-901c-02732f84f33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.064607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1168/2352] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:13 2022] DELETE /identity/v3/projects/f33168d0a0d84ef8b28a4e51d72c54e2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:14.069975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.070536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.070967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.099094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:14.100175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.172878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1185/2353] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:05:14.181742 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166d5f3-f1dc-43ac-a71a-4018d0561d6a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.182140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166d5f3-f1dc-43ac-a71a-4018d0561d6a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.182265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.182369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166d5f3-f1dc-43ac-a71a-4018d0561d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.183797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.209700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1166d5f3-f1dc-43ac-a71a-4018d0561d6a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:14.211234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1166d5f3-f1dc-43ac-a71a-4018d0561d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.223947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1169/2354] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:14.225074 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166d5f3-f1dc-43ac-a71a-4018d0561d6a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.236080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166d5f3-f1dc-43ac-a71a-4018d0561d6a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.243090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.243453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.244693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.244693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.245069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:05:14.245477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.248464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.293244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1170/2355] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:05:14.293946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.297653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.307242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c1499-9726-4973-836f-d060126dd268 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.313216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.313824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.314113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.314414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.317435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.322037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801ba17-2871-4adf-8bee-0a533cc3d086 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.328652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.331061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.331447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.332350 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.332863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] PATH_INFO: `/v3/users/ac01b2470edc4224be3eeda9aaf0d57f` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.334652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.334808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac01b2470edc4224be3eeda9aaf0d57f)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.336862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.350445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1186/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:14.352169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.365863 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4c9c-09e1-4dcd-b292-9a680e313b84 service placement] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.372216 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.373185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.373838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.374288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.376746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.381047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.422199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1187/2357] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:14 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:14.424541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.435623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac01b2470edc4224be3eeda9aaf0d57f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.444798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac01b2470edc4224be3eeda9aaf0d57f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.445681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac01b2470edc4224be3eeda9aaf0d57f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.454689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac01b2470edc4224be3eeda9aaf0d57f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.471860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac01b2470edc4224be3eeda9aaf0d57f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.478698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1171/2358] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:14 2022] DELETE /identity/v3/users/ac01b2470edc4224be3eeda9aaf0d57f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:14.511363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:14.530791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c7a4-52dc-40e6-ab55-2717f9f2b0f1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.617322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.618147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.618525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.619235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.619947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.622554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.659663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1188/2359] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:14 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:14.661432 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.663062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.700407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3080a1-17e9-454b-a279-fcac37a5394c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.705694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.706500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.707532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.707993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.708812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.710638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.723634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1172/2360] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:14.728006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.728353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.731492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.748059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcded-ef3a-469d-b4dc-fde9ad80f5d4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.752182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaead7c-9ecd-4785-86be-f5d2f7cab5df admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.757990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.758805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.759328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.759707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] PATH_INFO: `/v3/projects/751836838860475192d5deb3f365b904` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.761286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=751836838860475192d5deb3f365b904)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.761900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.762436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.763565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.764933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.766482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.767251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.770677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.793897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1189/2361] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:14.795006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.806020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a48e7-79ac-4796-b02a-4da9176491f0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:14.814607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263789-1d40-4c68-83f1-7cbec22bcf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:14.815456 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263789-1d40-4c68-83f1-7cbec22bcf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.815743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263789-1d40-4c68-83f1-7cbec22bcf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.816020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263789-1d40-4c68-83f1-7cbec22bcf85 admin admin] PATH_INFO: `/v3/projects/7ae7abeac3164573b324a8f4081e34cf/users/10f143cf59b3447f84c56faadf70f4b8/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.839733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75263789-1d40-4c68-83f1-7cbec22bcf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae7abeac3164573b324a8f4081e34cf, user_id=10f143cf59b3447f84c56faadf70f4b8, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:14.843426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75263789-1d40-4c68-83f1-7cbec22bcf85 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:14.859378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751836838860475192d5deb3f365b904', 'request_id': 'req-646e69a2-e546-4bdf-bde4-15b1d6eed38e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.867515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1190/2362] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:14 2022] PUT /identity/v3/projects/7ae7abeac3164573b324a8f4081e34cf/users/10f143cf59b3447f84c56faadf70f4b8/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:14.879472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:14.880022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:14.880491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:14.886835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751836838860475192d5deb3f365b904', 'request_id': 'req-646e69a2-e546-4bdf-bde4-15b1d6eed38e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.898106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751836838860475192d5deb3f365b904', 'request_id': 'req-646e69a2-e546-4bdf-bde4-15b1d6eed38e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.916367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] MFA Rules not processed for user `10f143cf59b3447f84c56faadf70f4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:14.917408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] The token cache is being invalidate because project 751836838860475192d5deb3f365b904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:14.918000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.918237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.918729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:14.920791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1173/2363] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:14 2022] DELETE /identity/v3/projects/751836838860475192d5deb3f365b904 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:14.924489 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:14.926762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:14.960979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:15.021314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e69a2-e546-4bdf-bde4-15b1d6eed38e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.035324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1191/2364] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:05:15.039603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.040976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:15.088890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:15.098082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.098902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.099314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.099809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] PATH_INFO: `/v3/users/22c48028f3814bcaa3b165e783c5355e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.101113 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c48028f3814bcaa3b165e783c5355e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.103175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.117654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6b4b-c5e7-453c-a067-4f75843e30b4 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.123984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.124596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.124874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.125146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.125779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.128620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.159532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c48028f3814bcaa3b165e783c5355e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.161926 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1192/2365] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:15 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:15.165973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.174168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c48028f3814bcaa3b165e783c5355e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.176220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c48028f3814bcaa3b165e783c5355e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.187445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c48028f3814bcaa3b165e783c5355e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.204691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c48028f3814bcaa3b165e783c5355e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.211711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1174/2366] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:14 2022] DELETE /identity/v3/users/22c48028f3814bcaa3b165e783c5355e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:05:15.237617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95515f59-ec9e-4fd3-a69a-26dfe4915eec admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.323031 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.323942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.324164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.324413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.328720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.330814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.363658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.365562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:15.378299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1193/2367] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:15 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:15.388387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1eb88-b1a5-40f4-9d3b-fe7c04076dc9 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.396214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.396968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.397688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.398058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.399382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.401407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.421888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1175/2368] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:15.426392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.444192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ac197-a843-42c9-9047-7acb2ed374a8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.449641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c952b8-a73a-4cb9-a0f8-ede96d4c6e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.450793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c952b8-a73a-4cb9-a0f8-ede96d4c6e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.451228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c952b8-a73a-4cb9-a0f8-ede96d4c6e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.451652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c952b8-a73a-4cb9-a0f8-ede96d4c6e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.452591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c952b8-a73a-4cb9-a0f8-ede96d4c6e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.454890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c952b8-a73a-4cb9-a0f8-ede96d4c6e11 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.477534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1194/2369] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:15.481329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.494403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4071c14-3801-4831-bb33-2a801a50380a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.500490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.501278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.501658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.502032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] PATH_INFO: `/v3/projects/1da29996e3ba42d487c589823f602e64/users/8e1ce37f10f244998ab94cf6e687bd12/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.520405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da29996e3ba42d487c589823f602e64, user_id=8e1ce37f10f244998ab94cf6e687bd12, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.523281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.540070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1176/2370] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:15 2022] PUT /identity/v3/projects/1da29996e3ba42d487c589823f602e64/users/8e1ce37f10f244998ab94cf6e687bd12/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:05:15.552172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.552465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.552772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.600427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] MFA Rules not processed for user `8e1ce37f10f244998ab94cf6e687bd12`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:15.601813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:15.656307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:15.694236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1195/2371] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:15.698279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.721356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.722976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:15.732483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:15.814711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5d78-c477-4c63-9a80-96bea6483f0c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.827363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.828511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.828962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.829331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.830669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.833673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.840656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499f4b-0a8a-4257-82c8-922c34e5950b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:15.846682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:15.847956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:15.848243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:15.848516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] PATH_INFO: `/v3/projects/14b44238df0443cc8daeb5af93071892` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:15.849772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b44238df0443cc8daeb5af93071892)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:15.851904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:15.889522 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1177/2372] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:15 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:15.902467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:15.929821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b44238df0443cc8daeb5af93071892', 'request_id': 'req-e425ae3c-60e7-4d06-8d6b-21355aa40eff'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.940142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b44238df0443cc8daeb5af93071892', 'request_id': 'req-e425ae3c-60e7-4d06-8d6b-21355aa40eff'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.948746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b44238df0443cc8daeb5af93071892', 'request_id': 'req-e425ae3c-60e7-4d06-8d6b-21355aa40eff'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.969295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] The token cache is being invalidate because project 14b44238df0443cc8daeb5af93071892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:15.969720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.971333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:15.974403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1196/2373] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:15 2022] DELETE /identity/v3/projects/14b44238df0443cc8daeb5af93071892 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:16.047979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed04b60-9a09-438c-a3e9-6c1909615a58 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:16.163166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:16.164303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:16.164945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:16.165498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:16.167172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:16.169994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:16.203863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1178/2374] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:15 2022] POST /identity/v3/users => generated 300 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:16.208413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:16.211061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:16.231229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425ae3c-60e7-4d06-8d6b-21355aa40eff admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:16.240783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:16.241740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:16.242279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:16.242764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:16.244035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:16.246212 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:16.257615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1197/2375] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:16.261881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:16.273881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e549e14-6fef-4127-a17f-b9bc193713cf admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:16.278479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:16.279258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:16.279642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:16.280016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] PATH_INFO: `/v3/projects/343cdc455b1647d2b8a86130c2384a37/users/d3f0348526444ace9f8eb66f599c87f7/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:16.298013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343cdc455b1647d2b8a86130c2384a37, user_id=d3f0348526444ace9f8eb66f599c87f7, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:16.301574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:16.317485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1179/2376] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:16 2022] PUT /identity/v3/projects/343cdc455b1647d2b8a86130c2384a37/users/d3f0348526444ace9f8eb66f599c87f7/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:16.321376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:16.333683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c980-db92-4dfd-a6ed-2cab03df6892 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:16.402344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242a36-c489-4d01-9f31-2900f0101915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:16.403161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242a36-c489-4d01-9f31-2900f0101915 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:16.403448 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242a36-c489-4d01-9f31-2900f0101915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:16.403837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242a36-c489-4d01-9f31-2900f0101915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:16.405412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242a36-c489-4d01-9f31-2900f0101915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:16.406768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242a36-c489-4d01-9f31-2900f0101915 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:16.408785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:16.426314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:16.428641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1198/2377] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:16.441726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eee075-6a1d-40cb-91ec-8477e6308c24 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:16.458978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:16.459620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:16.460275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:16.460275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] PATH_INFO: `/v3/projects/343cdc455b1647d2b8a86130c2384a37/users/d3f0348526444ace9f8eb66f599c87f7/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:16.462207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343cdc455b1647d2b8a86130c2384a37, user_id=d3f0348526444ace9f8eb66f599c87f7, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:16.465090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:16.473532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:16.482072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1180/2378] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:16 2022] PUT /identity/v3/projects/343cdc455b1647d2b8a86130c2384a37/users/d3f0348526444ace9f8eb66f599c87f7/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:05:16.491831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:16.492123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:16.492383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:16.523090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] MFA Rules not processed for user `d3f0348526444ace9f8eb66f599c87f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:16.524334 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:16.596102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1199/2379] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:16.607939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:16.609889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:16.677312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0203408-215a-4c23-8d8d-749104d4f035 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:16.681032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:16.681636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:16.681923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:16.682227 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:16.692289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:16.693730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:16.704013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1181/2380] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:05:17.215501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:17.216877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:17.228874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec5bc1-25a7-402a-82ab-02c6f4307c55 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:17.232465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:17.233071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:17.233333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:17.233602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:17.235288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:17.295061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:17.296504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:17.306281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1200/2381] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:21.330339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:21.339008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45dd28-16b6-4cf8-98a0-9e30b8c4ecd6 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:21.342549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843e07-22d7-4f77-82f8-6e4eb1ca0dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:21.343129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843e07-22d7-4f77-82f8-6e4eb1ca0dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:21.343403 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843e07-22d7-4f77-82f8-6e4eb1ca0dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:21.343669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843e07-22d7-4f77-82f8-6e4eb1ca0dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:21.345337 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5f843e07-22d7-4f77-82f8-6e4eb1ca0dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:21.402878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843e07-22d7-4f77-82f8-6e4eb1ca0dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:21.404300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843e07-22d7-4f77-82f8-6e4eb1ca0dd3 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:21.412981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1182/2382] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:05:23.492375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:23.554925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81130fe7-cc0a-4a9b-986c-b41a3dd47b43 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:23.559322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:23.559941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:23.560219 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:23.560490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] PATH_INFO: `/v3/users/10f143cf59b3447f84c56faadf70f4b8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:23.561593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f143cf59b3447f84c56faadf70f4b8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:23.563536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:23.585640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:23.610685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f143cf59b3447f84c56faadf70f4b8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:23.618497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f143cf59b3447f84c56faadf70f4b8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:23.631621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f143cf59b3447f84c56faadf70f4b8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:23.632266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f143cf59b3447f84c56faadf70f4b8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:23.639107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f143cf59b3447f84c56faadf70f4b8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:23.644987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1201/2383] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:23 2022] DELETE /identity/v3/users/10f143cf59b3447f84c56faadf70f4b8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:23.649434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:23.649907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:23.650004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:23.668625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:23.669821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:23.733225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1183/2384] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:23.744955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:23.746542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:23.803705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e656f13-01c6-4c3c-a48a-bfa5d04fd2d8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:23.807424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:23.807955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:23.808236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:23.808509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:23.818492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:23.819961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:23.829843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1202/2385] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:24.099067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:24.100541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:24.113423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0be5b0-4dc9-4ffc-a9c3-cb6b53752855 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:24.118279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:24.118915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:24.119193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:24.119468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] PATH_INFO: `/v3/projects/7ae7abeac3164573b324a8f4081e34cf` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:24.120590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae7abeac3164573b324a8f4081e34cf)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:24.122556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:24.160552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:24.171786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae7abeac3164573b324a8f4081e34cf', 'request_id': 'req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.180706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae7abeac3164573b324a8f4081e34cf', 'request_id': 'req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.188186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae7abeac3164573b324a8f4081e34cf', 'request_id': 'req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.199341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] The token cache is being invalidate because project 7ae7abeac3164573b324a8f4081e34cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:24.199630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.200547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.202058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1184/2386] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:24 2022] DELETE /identity/v3/projects/7ae7abeac3164573b324a8f4081e34cf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:24.206129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:24.215936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc65013-4726-4b28-aed3-9e422eda0843 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:24.273687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:24.274470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:24.274751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:24.275024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] PATH_INFO: `/v3/users/8e1ce37f10f244998ab94cf6e687bd12` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:24.276149 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1ce37f10f244998ab94cf6e687bd12)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:24.278131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:24.334663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:24.337306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1ce37f10f244998ab94cf6e687bd12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.350263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1ce37f10f244998ab94cf6e687bd12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.363303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1ce37f10f244998ab94cf6e687bd12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.363948 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1ce37f10f244998ab94cf6e687bd12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.370827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1ce37f10f244998ab94cf6e687bd12'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.376600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1203/2387] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:24 2022] DELETE /identity/v3/users/8e1ce37f10f244998ab94cf6e687bd12 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:24.651148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:24.652645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:24.666004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99518a1d-93f8-4e1f-8cc1-8c35a26a4085 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:24.724269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:24.724925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:24.725204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:24.725476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] PATH_INFO: `/v3/projects/1da29996e3ba42d487c589823f602e64` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:24.726625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da29996e3ba42d487c589823f602e64)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:24.728518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:24.774252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da29996e3ba42d487c589823f602e64', 'request_id': 'req-530658f8-6253-4fba-8aa2-73408d43835b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.781137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da29996e3ba42d487c589823f602e64', 'request_id': 'req-530658f8-6253-4fba-8aa2-73408d43835b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.787587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da29996e3ba42d487c589823f602e64', 'request_id': 'req-530658f8-6253-4fba-8aa2-73408d43835b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.798584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] The token cache is being invalidate because project 1da29996e3ba42d487c589823f602e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:24.798876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.799534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.801458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1185/2388] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:24 2022] DELETE /identity/v3/projects/1da29996e3ba42d487c589823f602e64 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:24.805740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:24.807240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:24.820463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014d72f-5f16-4a8c-8239-d40dcbfe23c0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:24.876273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:24.876892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:24.877166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:24.877435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] PATH_INFO: `/v3/users/d3f0348526444ace9f8eb66f599c87f7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:24.879548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f0348526444ace9f8eb66f599c87f7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:24.881493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:24.927082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f0348526444ace9f8eb66f599c87f7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.934137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f0348526444ace9f8eb66f599c87f7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.946204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f0348526444ace9f8eb66f599c87f7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.946830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f0348526444ace9f8eb66f599c87f7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.953816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-94a504d3-6ee0-4f4f-ab7c-6cfebcbc9728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f0348526444ace9f8eb66f599c87f7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:24.960143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1204/2389] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:24 2022] DELETE /identity/v3/users/d3f0348526444ace9f8eb66f599c87f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:25.233353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.234823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:25.248289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530658f8-6253-4fba-8aa2-73408d43835b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.298468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:25.307051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.307696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.308286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.308686 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] PATH_INFO: `/v3/projects/343cdc455b1647d2b8a86130c2384a37` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.309921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=343cdc455b1647d2b8a86130c2384a37)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.312374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:25.358974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343cdc455b1647d2b8a86130c2384a37', 'request_id': 'req-3b1fda9c-6f08-4947-bb85-9cae4f82b402'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:25.366603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343cdc455b1647d2b8a86130c2384a37', 'request_id': 'req-3b1fda9c-6f08-4947-bb85-9cae4f82b402'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:25.372719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343cdc455b1647d2b8a86130c2384a37', 'request_id': 'req-3b1fda9c-6f08-4947-bb85-9cae4f82b402'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:25.383025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] The token cache is being invalidate because project 343cdc455b1647d2b8a86130c2384a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:25.383310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:25.383927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3b1fda9c-6f08-4947-bb85-9cae4f82b402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:25.385467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1186/2390] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:25 2022] DELETE /identity/v3/projects/343cdc455b1647d2b8a86130c2384a37 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:25.392072 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0d11-999a-408b-a8f2-8b0842e49996 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.392426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0d11-999a-408b-a8f2-8b0842e49996 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.392764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d0d11-999a-408b-a8f2-8b0842e49996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.413036 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-017d0d11-999a-408b-a8f2-8b0842e49996 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:25.414185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-017d0d11-999a-408b-a8f2-8b0842e49996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:25.446699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:25.472336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1205/2391] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:25.481691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90da64a-667d-4a6a-8420-e2587773916f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.481968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90da64a-667d-4a6a-8420-e2587773916f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.482266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90da64a-667d-4a6a-8420-e2587773916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.502314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d90da64a-667d-4a6a-8420-e2587773916f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:25.503497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d90da64a-667d-4a6a-8420-e2587773916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:25.511587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1187/2392] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:25.515767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d0d11-999a-408b-a8f2-8b0842e49996 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.525436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d0d11-999a-408b-a8f2-8b0842e49996 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.529991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.530604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.530885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.531156 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.531833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:05:25.532138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.533721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:25.545615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1206/2393] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:05:25.549805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90da64a-667d-4a6a-8420-e2587773916f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.559812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90da64a-667d-4a6a-8420-e2587773916f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.564383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.564961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.565235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.565499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.566139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.568304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:25.595699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1188/2394] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:25 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:25.600289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.610047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480374e6-a2f5-4a9d-b116-47bf9f1ff478 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.665151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.665709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.665995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.666306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.666941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.668908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:25.690923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1207/2395] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:25 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:25.695049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.705873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc419bd-1490-4c7c-bde8-7c1e300e2b06 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.710671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.711270 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.711548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.711819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.712462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.714063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:25.724580 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1189/2396] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:25.728533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.739603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60af82-f67c-4d54-bb30-f3ae44e1a30f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.744307 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc388-b296-4665-8202-c57639e90988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.744896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc388-b296-4665-8202-c57639e90988 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.745171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc388-b296-4665-8202-c57639e90988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.745444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc388-b296-4665-8202-c57639e90988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.746124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc388-b296-4665-8202-c57639e90988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.747709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc388-b296-4665-8202-c57639e90988 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:25.758681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1208/2397] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:25.762295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.772934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c3717-65a0-48c2-a7b9-87f4f45283f3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.777710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.778380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.778657 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.778925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] PATH_INFO: `/v3/projects/d9c9e6c2507243b49a52d85cd535585b/users/e9cf494268394df3af835cfca775e4a0/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.793694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c9e6c2507243b49a52d85cd535585b, user_id=e9cf494268394df3af835cfca775e4a0, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.796527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:25.809789 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1190/2398] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:25 2022] PUT /identity/v3/projects/d9c9e6c2507243b49a52d85cd535585b/users/e9cf494268394df3af835cfca775e4a0/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:25.821297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501046a-ff96-4892-8b5f-5ad1c7e29103 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.821769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501046a-ff96-4892-8b5f-5ad1c7e29103 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.821894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501046a-ff96-4892-8b5f-5ad1c7e29103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.853715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1501046a-ff96-4892-8b5f-5ad1c7e29103 None None] MFA Rules not processed for user `e9cf494268394df3af835cfca775e4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:25.854951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1501046a-ff96-4892-8b5f-5ad1c7e29103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:25.918853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1209/2399] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:25.923462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:25.985711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aaff6-cace-471a-ac4e-482e93f0613d admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:25.990946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:25.991542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:25.991821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:25.992093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:25.992719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:25.994651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.020490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1191/2400] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:25 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:26.025171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501046a-ff96-4892-8b5f-5ad1c7e29103 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.035695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501046a-ff96-4892-8b5f-5ad1c7e29103 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.068377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:26.093995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.094632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.094908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.095179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.095809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.097713 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.117840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1210/2401] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:26 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:05:26.121850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.132622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5cdbe-0e61-42a4-bf3f-0241fc8776c8 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.137279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.137868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.138181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.138454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.139085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.140662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.141862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:26.152652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1192/2402] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:26.156452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.167547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cefe61-ec08-4feb-99a1-7bc4180810e1 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.172173 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.172760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.173040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.173314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] PATH_INFO: `/v3/projects/2d0d6f0475f94058b2fc8ff0170e77f9/users/e81f0e57e5c14db59a735ebbf9c2e04f/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.188470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0d6f0475f94058b2fc8ff0170e77f9, user_id=e81f0e57e5c14db59a735ebbf9c2e04f, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.191245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.204813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1211/2403] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:26 2022] PUT /identity/v3/projects/2d0d6f0475f94058b2fc8ff0170e77f9/users/e81f0e57e5c14db59a735ebbf9c2e04f/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:26.209035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.218963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e158-0c1f-4748-bb45-a60bbe81a91c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.273863 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ea9bd-7554-4c5f-8bee-ac65939c4f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.274533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea9bd-7554-4c5f-8bee-ac65939c4f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.274809 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea9bd-7554-4c5f-8bee-ac65939c4f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.275075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea9bd-7554-4c5f-8bee-ac65939c4f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.275701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ea9bd-7554-4c5f-8bee-ac65939c4f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.277301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ea9bd-7554-4c5f-8bee-ac65939c4f0e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.287713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1193/2404] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:26.292064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.303344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e8cd-4f0c-4436-b95e-0637423c39ce admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.307857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.308492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.308768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.309058 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] PATH_INFO: `/v3/projects/2d0d6f0475f94058b2fc8ff0170e77f9/users/e81f0e57e5c14db59a735ebbf9c2e04f/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.310959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0d6f0475f94058b2fc8ff0170e77f9, user_id=e81f0e57e5c14db59a735ebbf9c2e04f, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.313587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.323651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1212/2405] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:26 2022] PUT /identity/v3/projects/2d0d6f0475f94058b2fc8ff0170e77f9/users/e81f0e57e5c14db59a735ebbf9c2e04f/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:26.334854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0d14e-abbe-41dc-b84f-d2ac2c186872 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.335146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0d14e-abbe-41dc-b84f-d2ac2c186872 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.335438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0d14e-abbe-41dc-b84f-d2ac2c186872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.366538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-9fc0d14e-abbe-41dc-b84f-d2ac2c186872 None None] MFA Rules not processed for user `e81f0e57e5c14db59a735ebbf9c2e04f`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:26.367768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-9fc0d14e-abbe-41dc-b84f-d2ac2c186872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:26.434928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1194/2406] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:26.445733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.447443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:26.508064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39829eff-a803-4d13-9bf7-b69cdc93eb66 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.511704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10ea47-fd65-4ffb-99f0-1c1228e41aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.512297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ea47-fd65-4ffb-99f0-1c1228e41aaa service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.512573 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ea47-fd65-4ffb-99f0-1c1228e41aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.512843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10ea47-fd65-4ffb-99f0-1c1228e41aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.522570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ea47-fd65-4ffb-99f0-1c1228e41aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.523990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10ea47-fd65-4ffb-99f0-1c1228e41aaa service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.533329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1213/2407] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:26.667549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0d14e-abbe-41dc-b84f-d2ac2c186872 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.729896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0d14e-abbe-41dc-b84f-d2ac2c186872 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.734389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.735006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.735278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.735750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] PATH_INFO: `/v3/users/e9cf494268394df3af835cfca775e4a0` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.736853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cf494268394df3af835cfca775e4a0)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.738788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.759746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:26.784436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cf494268394df3af835cfca775e4a0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:26.791810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cf494268394df3af835cfca775e4a0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:26.792497 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cf494268394df3af835cfca775e4a0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:26.799244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cf494268394df3af835cfca775e4a0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:26.811423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cf494268394df3af835cfca775e4a0'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:26.817194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1195/2408] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:26 2022] DELETE /identity/v3/users/e9cf494268394df3af835cfca775e4a0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:26.822510 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.822994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.823094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.841542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:26.842744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:26.901240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1214/2409] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:26.910890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:26.912963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:26.969323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce597d-61ef-4ad4-b1b7-d2ba0af635d5 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:26.973115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:26.974254 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:26.974538 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:26.974892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:26.983753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:26.985170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:26.995321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1196/2410] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:27.268537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:27.270205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:27.282500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ecc72-2e36-4cb6-84bb-58bf605e3b55 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:27.287286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:27.288052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:27.288329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:27.288987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] PATH_INFO: `/v3/projects/d9c9e6c2507243b49a52d85cd535585b` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:27.289750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c9e6c2507243b49a52d85cd535585b)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:27.291935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:27.328642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:27.347099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c9e6c2507243b49a52d85cd535585b', 'request_id': 'req-dc970c25-79af-4848-af81-671412ca557e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.352695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c9e6c2507243b49a52d85cd535585b', 'request_id': 'req-dc970c25-79af-4848-af81-671412ca557e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.358783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c9e6c2507243b49a52d85cd535585b', 'request_id': 'req-dc970c25-79af-4848-af81-671412ca557e'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.370968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] The token cache is being invalidate because project d9c9e6c2507243b49a52d85cd535585b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:27.371282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.371887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.373349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1215/2411] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:27 2022] DELETE /identity/v3/projects/d9c9e6c2507243b49a52d85cd535585b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:27.377470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:27.387872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71a9f3-7e4b-4120-874e-6caa7767afeb service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:27.444131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:27.444763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:27.445043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:27.445316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] PATH_INFO: `/v3/users/e81f0e57e5c14db59a735ebbf9c2e04f` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:27.446529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81f0e57e5c14db59a735ebbf9c2e04f)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:27.448436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:27.488454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:27.495250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81f0e57e5c14db59a735ebbf9c2e04f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.502625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81f0e57e5c14db59a735ebbf9c2e04f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.503353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81f0e57e5c14db59a735ebbf9c2e04f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.511001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81f0e57e5c14db59a735ebbf9c2e04f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.522770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-281963bf-930f-494f-bc62-c9cdab350eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81f0e57e5c14db59a735ebbf9c2e04f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.528543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1197/2412] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:27 2022] DELETE /identity/v3/users/e81f0e57e5c14db59a735ebbf9c2e04f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:27.808885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:27.810328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:27.823469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc970c25-79af-4848-af81-671412ca557e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:27.879299 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:27.880025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:27.880515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:27.880922 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] PATH_INFO: `/v3/projects/2d0d6f0475f94058b2fc8ff0170e77f9` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:27.882042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0d6f0475f94058b2fc8ff0170e77f9)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:27.883959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:27.929972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0d6f0475f94058b2fc8ff0170e77f9', 'request_id': 'req-cfeb717f-d422-413d-96d8-f2118f79a38a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.935424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0d6f0475f94058b2fc8ff0170e77f9', 'request_id': 'req-cfeb717f-d422-413d-96d8-f2118f79a38a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.941629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0d6f0475f94058b2fc8ff0170e77f9', 'request_id': 'req-cfeb717f-d422-413d-96d8-f2118f79a38a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.954259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] The token cache is being invalidate because project 2d0d6f0475f94058b2fc8ff0170e77f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:27.954530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.955140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cfeb717f-d422-413d-96d8-f2118f79a38a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:27.956594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1216/2413] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:27 2022] DELETE /identity/v3/projects/2d0d6f0475f94058b2fc8ff0170e77f9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:27.963502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12aa64-9fc1-47e1-9cc3-22c5ecbd4f34 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:27.964001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12aa64-9fc1-47e1-9cc3-22c5ecbd4f34 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:27.964119 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12aa64-9fc1-47e1-9cc3-22c5ecbd4f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:27.984190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3b12aa64-9fc1-47e1-9cc3-22c5ecbd4f34 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:27.985380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3b12aa64-9fc1-47e1-9cc3-22c5ecbd4f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:28.042803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1198/2414] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:28.050952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951e2d-a5f4-4503-bc04-8e0dc9645266 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.051171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951e2d-a5f4-4503-bc04-8e0dc9645266 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.051438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951e2d-a5f4-4503-bc04-8e0dc9645266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.070504 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-61951e2d-a5f4-4503-bc04-8e0dc9645266 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:28.071716 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-61951e2d-a5f4-4503-bc04-8e0dc9645266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:28.079681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1217/2415] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:28.084625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12aa64-9fc1-47e1-9cc3-22c5ecbd4f34 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:28.094957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12aa64-9fc1-47e1-9cc3-22c5ecbd4f34 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:28.099625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:28.100228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.100508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.100781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.101431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:05:28.101734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:28.103373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:28.115516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1199/2416] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:05:28.119814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61951e2d-a5f4-4503-bc04-8e0dc9645266 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:28.128810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61951e2d-a5f4-4503-bc04-8e0dc9645266 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:28.134050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:28.134677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.134951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.135218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.135830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:28.137704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:28.165474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1218/2417] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:28 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:28.170607 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:28.181310 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfdbf1-11dd-459c-b90e-8170f1ba3dd8 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:28.237437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:28.238032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.238443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.238713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.239903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:28.241923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:28.263199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1200/2418] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:28 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:28.267297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:28.277594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620f61-f034-4f84-9358-9ca2a4215751 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:28.282242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:28.282834 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.283113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.283385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.284016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:28.285605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:28.295723 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1219/2419] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:28.299542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:28.309854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e73ec5-51ab-453b-99f3-201f43755c82 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:28.314345 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb953-8fd2-448d-8f42-1065bebc447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:28.314927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb953-8fd2-448d-8f42-1065bebc447a admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.315203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb953-8fd2-448d-8f42-1065bebc447a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.315467 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb953-8fd2-448d-8f42-1065bebc447a admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.316090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb953-8fd2-448d-8f42-1065bebc447a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:28.318240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb953-8fd2-448d-8f42-1065bebc447a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:28.328751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1201/2420] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:28.332783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:28.339281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:28.342934 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472690-4ba3-4be3-a58c-9f345938df9b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:28.348452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:28.349614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.350143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.350608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] PATH_INFO: `/v3/projects/edf11783f7a94e8398bc26d4268db87f/users/bb74e662687548c390006cae85c9df08/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.365963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf11783f7a94e8398bc26d4268db87f, user_id=bb74e662687548c390006cae85c9df08, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:28.368674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:28.380884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1220/2421] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:28 2022] PUT /identity/v3/projects/edf11783f7a94e8398bc26d4268db87f/users/bb74e662687548c390006cae85c9df08/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:28.391353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288872-8855-46de-bf07-dcc3519861bd None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.391637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288872-8855-46de-bf07-dcc3519861bd None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.391913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288872-8855-46de-bf07-dcc3519861bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.420061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-93288872-8855-46de-bf07-dcc3519861bd None None] MFA Rules not processed for user `bb74e662687548c390006cae85c9df08`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:28.421251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-93288872-8855-46de-bf07-dcc3519861bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:28.433335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:28.487660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1202/2422] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:28.499915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:28.501614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:28.557474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166da9-91b1-475c-aa86-532a96cbf6e7 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:28.561228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f95e3d-3c2d-4c3a-b565-7ce19e50d342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:28.561757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95e3d-3c2d-4c3a-b565-7ce19e50d342 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:28.562033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95e3d-3c2d-4c3a-b565-7ce19e50d342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:28.562333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95e3d-3c2d-4c3a-b565-7ce19e50d342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:28.570750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f95e3d-3c2d-4c3a-b565-7ce19e50d342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:28.572172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f95e3d-3c2d-4c3a-b565-7ce19e50d342 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:28.581259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1221/2423] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:38.484753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=21 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:38.577108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:38.680700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93288872-8855-46de-bf07-dcc3519861bd None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:38.748019 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93288872-8855-46de-bf07-dcc3519861bd None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:38.752387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:38.753002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:38.753275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:38.753544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] PATH_INFO: `/v3/users/bb74e662687548c390006cae85c9df08` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:38.754661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb74e662687548c390006cae85c9df08)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:38.756677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:38.801080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb74e662687548c390006cae85c9df08'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:38.807676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb74e662687548c390006cae85c9df08'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:38.808424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb74e662687548c390006cae85c9df08'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:38.815372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb74e662687548c390006cae85c9df08'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:38.827804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb74e662687548c390006cae85c9df08'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:38.833767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1203/2424] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:38 2022] DELETE /identity/v3/users/bb74e662687548c390006cae85c9df08 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:38.838760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:38.839052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:38.839352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:38.857864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:38.859129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:38.919860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1222/2425] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:38.930679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:38.932108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:38.990987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332313d-6588-4461-bf9b-ec1285066a78 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:38.994612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31007e48-cdad-4352-b7e6-fb9ec9201866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:38.995208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007e48-cdad-4352-b7e6-fb9ec9201866 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:38.995487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007e48-cdad-4352-b7e6-fb9ec9201866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:38.995758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31007e48-cdad-4352-b7e6-fb9ec9201866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.004677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31007e48-cdad-4352-b7e6-fb9ec9201866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.006606 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31007e48-cdad-4352-b7e6-fb9ec9201866 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.016013 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1204/2426] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:39.287306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:39.289098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:39.301939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d72af-7305-4d93-9c60-28b3d3146908 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:39.307992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:39.308657 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.308957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.309201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] PATH_INFO: `/v3/projects/edf11783f7a94e8398bc26d4268db87f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.310465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf11783f7a94e8398bc26d4268db87f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.312351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.369965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf11783f7a94e8398bc26d4268db87f', 'request_id': 'req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:39.375735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf11783f7a94e8398bc26d4268db87f', 'request_id': 'req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:39.383529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf11783f7a94e8398bc26d4268db87f', 'request_id': 'req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:39.399401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] The token cache is being invalidate because project edf11783f7a94e8398bc26d4268db87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:39.399687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:39.400370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-44cbaebc-8155-4f9c-b72b-aedc3320fd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:39.402460 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1223/2427] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:39 2022] DELETE /identity/v3/projects/edf11783f7a94e8398bc26d4268db87f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:39.407853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faf163-321d-4be0-8706-73b2edeab15a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.408122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faf163-321d-4be0-8706-73b2edeab15a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.408475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faf163-321d-4be0-8706-73b2edeab15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.428783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-33faf163-321d-4be0-8706-73b2edeab15a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:39.429975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-33faf163-321d-4be0-8706-73b2edeab15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:39.450762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:39.497542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1205/2428] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:05:39.505352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b2c9-49a6-45f2-a5a5-63c00bccb03a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.505729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b2c9-49a6-45f2-a5a5-63c00bccb03a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.506564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b2c9-49a6-45f2-a5a5-63c00bccb03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.532486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4d36b2c9-49a6-45f2-a5a5-63c00bccb03a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:39.533737 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4d36b2c9-49a6-45f2-a5a5-63c00bccb03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:39.542752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1224/2429] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:39.547142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faf163-321d-4be0-8706-73b2edeab15a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:39.558448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faf163-321d-4be0-8706-73b2edeab15a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:39.563464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:39.564130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.564413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.564683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.565502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:05:39.566106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.569129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.583031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1206/2430] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:05:39.587890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b2c9-49a6-45f2-a5a5-63c00bccb03a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:39.597461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b2c9-49a6-45f2-a5a5-63c00bccb03a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:39.603642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:39.604356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.604631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.604900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.605534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.607452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.644532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1225/2431] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:05:39 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:39.649915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:39.661200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352d48b-5e4a-4c17-8c59-a3338a886f90 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:39.733618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:39.734266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.734557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.734821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.735487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.737396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.760939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1207/2432] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:05:39 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:05:39.767022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:39.778844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9b83c-6759-483f-8bfa-8ae31b2568e3 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:39.783501 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:39.784030 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.784303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.784577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.785205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.788236 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.802538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1226/2433] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:39.807284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:39.818072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3edbe8-4a2b-47f0-a0d2-686398f31660 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:39.822999 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059781b-c444-4760-ae62-21c388f9c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:39.823608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059781b-c444-4760-ae62-21c388f9c86f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.824015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059781b-c444-4760-ae62-21c388f9c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.824289 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059781b-c444-4760-ae62-21c388f9c86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.825196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059781b-c444-4760-ae62-21c388f9c86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.826852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059781b-c444-4760-ae62-21c388f9c86f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.838807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1208/2434] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:05:39.845368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:39.854130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa3bfa-3f52-4697-ad1e-a373ff824fd5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:39.859700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:39.860807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.861311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.861818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] PATH_INFO: `/v3/projects/08d9e81d8ce040e880e0ce12203bbc0d/users/8fe39455c13145ba9c99def40ba99a0d/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.878717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d9e81d8ce040e880e0ce12203bbc0d, user_id=8fe39455c13145ba9c99def40ba99a0d, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:39.881471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:39.899147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1227/2435] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:05:39 2022] PUT /identity/v3/projects/08d9e81d8ce040e880e0ce12203bbc0d/users/8fe39455c13145ba9c99def40ba99a0d/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:39.910076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb665a8-a623-44f6-835d-eecf1095a3a0 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:39.910393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb665a8-a623-44f6-835d-eecf1095a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:39.910668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb665a8-a623-44f6-835d-eecf1095a3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:39.941500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6cb665a8-a623-44f6-835d-eecf1095a3a0 None None] MFA Rules not processed for user `8fe39455c13145ba9c99def40ba99a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:39.942758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6cb665a8-a623-44f6-835d-eecf1095a3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:40.018062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1209/2436] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:40.030596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:40.032379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:40.060396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:40.100097 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88448940-8cb9-413b-bc83-d228cb2e2811 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:40.103974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a383806-8655-4e88-8da6-8b26b9310762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:40.104587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a383806-8655-4e88-8da6-8b26b9310762 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:40.104861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a383806-8655-4e88-8da6-8b26b9310762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:40.105132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a383806-8655-4e88-8da6-8b26b9310762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:40.114331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a383806-8655-4e88-8da6-8b26b9310762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:40.115814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a383806-8655-4e88-8da6-8b26b9310762 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:40.125819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1228/2437] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:45.116028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb665a8-a623-44f6-835d-eecf1095a3a0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:45.136130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:45.220645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb665a8-a623-44f6-835d-eecf1095a3a0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:45.225203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:45.225848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:45.226186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:45.226569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] PATH_INFO: `/v3/users/8fe39455c13145ba9c99def40ba99a0d` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:45.227729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe39455c13145ba9c99def40ba99a0d)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:45.229647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:45.276832 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe39455c13145ba9c99def40ba99a0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.283980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe39455c13145ba9c99def40ba99a0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.284664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe39455c13145ba9c99def40ba99a0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.291722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe39455c13145ba9c99def40ba99a0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.303545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe39455c13145ba9c99def40ba99a0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.309884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1210/2438] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:05:45 2022] DELETE /identity/v3/users/8fe39455c13145ba9c99def40ba99a0d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:45.314343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:45.314817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:45.315021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:45.363398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:05:45.364531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:45.428033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1229/2439] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:05:45.438388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:45.439814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:45.497262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:45.513226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505970c3-eb3d-4ce4-a7f2-7e3c01f725ea admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:45.516829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49369f92-6367-4794-8d2f-481faf26d1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:45.517418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369f92-6367-4794-8d2f-481faf26d1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:45.517691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369f92-6367-4794-8d2f-481faf26d1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:45.517955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49369f92-6367-4794-8d2f-481faf26d1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:45.527234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49369f92-6367-4794-8d2f-481faf26d1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:45.528643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49369f92-6367-4794-8d2f-481faf26d1b7 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:45.537740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1211/2440] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:05:45.803416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:05:45.805065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:05:45.820656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa9116-864a-45ff-8822-19648c1c2ead None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:05:45.826732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413416-712e-43a0-81a6-838254861953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:05:45.827367 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413416-712e-43a0-81a6-838254861953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:05:45.827662 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413416-712e-43a0-81a6-838254861953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:05:45.827905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12413416-712e-43a0-81a6-838254861953 admin admin] PATH_INFO: `/v3/projects/08d9e81d8ce040e880e0ce12203bbc0d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:05:45.829088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12413416-712e-43a0-81a6-838254861953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d9e81d8ce040e880e0ce12203bbc0d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:05:45.830950 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12413416-712e-43a0-81a6-838254861953 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:05:45.877130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d9e81d8ce040e880e0ce12203bbc0d', 'request_id': 'req-12413416-712e-43a0-81a6-838254861953'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.883271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d9e81d8ce040e880e0ce12203bbc0d', 'request_id': 'req-12413416-712e-43a0-81a6-838254861953'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.889200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d9e81d8ce040e880e0ce12203bbc0d', 'request_id': 'req-12413416-712e-43a0-81a6-838254861953'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.901164 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12413416-712e-43a0-81a6-838254861953 admin admin] The token cache is being invalidate because project 08d9e81d8ce040e880e0ce12203bbc0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:05:45.901548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.902180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:05:45.903697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1230/2441] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:05:45 2022] DELETE /identity/v3/projects/08d9e81d8ce040e880e0ce12203bbc0d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:05:55.533700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=8 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:05:55.898475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:05.920951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5917e0-a996-4f35-97db-3ec26c5f5fa2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:06:05.921457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5917e0-a996-4f35-97db-3ec26c5f5fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:06:05.921457 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5917e0-a996-4f35-97db-3ec26c5f5fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:06:05.946488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3c5917e0-a996-4f35-97db-3ec26c5f5fa2 None None] MFA Rules not processed for user `2b2e394413974cd282048e582447aeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:06:05.947678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3c5917e0-a996-4f35-97db-3ec26c5f5fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:06:06.002386 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1212/2442] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:06:07.087383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:06:07.088778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:06:07.177845 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12413416-712e-43a0-81a6-838254861953 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:06:07.183191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:06:07.183788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:06:07.184062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:06:07.184328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:06:07.186022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:06:07.198163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:06:07.199977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:06:07.209576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1231/2443] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:06:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:06:15.995603 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=25 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:17.205449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=41 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:27.950189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf419c-464a-4698-8a4a-7c46a93e8536 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:06:27.950740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf419c-464a-4698-8a4a-7c46a93e8536 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:06:27.950740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf419c-464a-4698-8a4a-7c46a93e8536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:06:27.979627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-becf419c-464a-4698-8a4a-7c46a93e8536 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:06:27.981419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-becf419c-464a-4698-8a4a-7c46a93e8536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:06:28.039820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1213/2444] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:06:28.088131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:06:28.089794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:06:28.159252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbf93a-3379-41ee-80bf-9525ca383655 service placement] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:06:28.164562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:06:28.165177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:06:28.165461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:06:28.165874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:06:28.174585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:06:28.176154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:06:28.184774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1232/2445] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:06:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:06:38.033192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=32 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:38.180988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=32 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:46.004970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c43f60-d10f-48c2-bb4b-867519a499b4 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:06:46.005472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c43f60-d10f-48c2-bb4b-867519a499b4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:06:46.005574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c43f60-d10f-48c2-bb4b-867519a499b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:06:46.024591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-41c43f60-d10f-48c2-bb4b-867519a499b4 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:06:46.025708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-41c43f60-d10f-48c2-bb4b-867519a499b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:06:46.032946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1214/2446] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:06:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:06:46.045330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:06:46.055725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4111f9-7a6d-408c-bc90-54ed356d9d03 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:06:46.061023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:06:46.061609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:06:46.061894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:06:46.062200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:06:46.070005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:06:46.071639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:06:46.080168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1233/2447] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:06:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:06:56.019707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:06:56.076896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:10.288622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:10.289104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:10.289342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:10.308825 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:10.310054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:10.318580 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1215/2448] 10.222.0.52 () {58 vars in 967 bytes} [Fri Sep 9 15:07:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:10.334050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:10.344874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e6e0-c4da-43eb-9e6d-9e2adc3191f7 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:10.349947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:10.350575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:10.350857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:10.351131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:10.359725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:10.361297 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:10.369457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1234/2449] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:07:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:07:13.942866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:13.944253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:14.019866 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fc53d-e69a-4c82-bbf0-3de498a9b506 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:14.023471 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:14.024072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:14.024348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:14.024619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:14.026366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:14.084347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:14.085777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:14.094904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1216/2450] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:20.366108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:20.564884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:20.575223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4c10e-c72d-46c5-9da7-991b9d471186 service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:20.580232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:20.581079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:20.581514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:20.581791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:20.583585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:20.655681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:20.657251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:20.668624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1235/2451] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:23.916773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:23.926166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d67e3-bad3-48cb-9a6f-8385f5e737d5 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:23.930477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:23.931440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:23.931982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:23.932434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:23.934531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:23.947643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:23.949081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:23.959805 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1217/2452] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:27.568084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:27.572805 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:27.573503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:27.575472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:27.592428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd69393-fbb4-4835-9d00-6376313902b7 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:27.594342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eee1f7-5cb9-45e4-b0ce-bfc27e851936 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:27.599084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:27.599723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:27.600005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:27.600282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] PATH_INFO: `/v3/users/a40119a73f11466396851382adc1d37f` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:27.601404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40119a73f11466396851382adc1d37f)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:27.603632 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:27.604774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:27.615703 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:27.616808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:27.617256 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] PATH_INFO: `/v3/users/b12eee6f7bee44c6a2cb31de030e0e4d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:27.619659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12eee6f7bee44c6a2cb31de030e0e4d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:27.622421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:27.677822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40119a73f11466396851382adc1d37f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.688465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40119a73f11466396851382adc1d37f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.689399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40119a73f11466396851382adc1d37f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.698057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40119a73f11466396851382adc1d37f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.706537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:27.707766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12eee6f7bee44c6a2cb31de030e0e4d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.719380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12eee6f7bee44c6a2cb31de030e0e4d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.728573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40119a73f11466396851382adc1d37f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.737715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1218/2453] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:27 2022] DELETE /identity/v3/users/a40119a73f11466396851382adc1d37f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:27.738398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12eee6f7bee44c6a2cb31de030e0e4d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.739131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12eee6f7bee44c6a2cb31de030e0e4d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.748492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12eee6f7bee44c6a2cb31de030e0e4d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:27.756900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1236/2454] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:27 2022] DELETE /identity/v3/users/b12eee6f7bee44c6a2cb31de030e0e4d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:27.937133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:27.940462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:27.954708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:27.956186 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:28.016829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ad4eb-1cce-4395-bd68-712510ac5fcc admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.046355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab31a1-4df8-406b-b6b1-dba774011873 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.051431 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.052254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.052586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.052872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] PATH_INFO: `/v3/projects/9824ee10a1cb45f598bb2a1873e7a331` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.054048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9824ee10a1cb45f598bb2a1873e7a331)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.056174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.066303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:28.082215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.082996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.083366 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.083728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] PATH_INFO: `/v3/projects/9b4ba84c56204a9a874a8a88e430d2a4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.084962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4ba84c56204a9a874a8a88e430d2a4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.087157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.137654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9824ee10a1cb45f598bb2a1873e7a331', 'request_id': 'req-c7659227-6577-4931-a3a9-6c0c59d32806'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.143935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9824ee10a1cb45f598bb2a1873e7a331', 'request_id': 'req-c7659227-6577-4931-a3a9-6c0c59d32806'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.144171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4ba84c56204a9a874a8a88e430d2a4', 'request_id': 'req-c2738042-5217-44ed-896b-3e9ce4480edc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.150443 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9824ee10a1cb45f598bb2a1873e7a331', 'request_id': 'req-c7659227-6577-4931-a3a9-6c0c59d32806'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.152530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4ba84c56204a9a874a8a88e430d2a4', 'request_id': 'req-c2738042-5217-44ed-896b-3e9ce4480edc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.159205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4ba84c56204a9a874a8a88e430d2a4', 'request_id': 'req-c2738042-5217-44ed-896b-3e9ce4480edc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.163032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] The token cache is being invalidate because project 9824ee10a1cb45f598bb2a1873e7a331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:28.163317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.163924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c7659227-6577-4931-a3a9-6c0c59d32806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.165493 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1237/2455] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:27 2022] DELETE /identity/v3/projects/9824ee10a1cb45f598bb2a1873e7a331 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:28.170406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] The token cache is being invalidate because project 9b4ba84c56204a9a874a8a88e430d2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:28.170694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079aaab-57be-4181-850a-90d7464837cd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.171485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.171962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079aaab-57be-4181-850a-90d7464837cd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.172272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.172492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079aaab-57be-4181-850a-90d7464837cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.173833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1219/2456] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:27 2022] DELETE /identity/v3/projects/9b4ba84c56204a9a874a8a88e430d2a4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:07:28.177587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.179056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:28.206973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:28.224544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8079aaab-57be-4181-850a-90d7464837cd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:28.225833 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8079aaab-57be-4181-850a-90d7464837cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:28.249753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2738042-5217-44ed-896b-3e9ce4480edc admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.254437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.255068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.255347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.255618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] PATH_INFO: `/v3/users/069b3d8ccba24a5aacad5401d9c2e17d` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.256744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=069b3d8ccba24a5aacad5401d9c2e17d)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.258693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.289808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1238/2457] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:07:28.298221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601747ec-27b4-4469-a049-2becda214634 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.298494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601747ec-27b4-4469-a049-2becda214634 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.298764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601747ec-27b4-4469-a049-2becda214634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.314503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069b3d8ccba24a5aacad5401d9c2e17d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.318811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-601747ec-27b4-4469-a049-2becda214634 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:28.319962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-601747ec-27b4-4469-a049-2becda214634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:28.322702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069b3d8ccba24a5aacad5401d9c2e17d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.323344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069b3d8ccba24a5aacad5401d9c2e17d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.328859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1239/2458] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:07:28.332822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601747ec-27b4-4469-a049-2becda214634 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.333933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069b3d8ccba24a5aacad5401d9c2e17d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.341728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601747ec-27b4-4469-a049-2becda214634 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.346968 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069b3d8ccba24a5aacad5401d9c2e17d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.347116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.347631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.347913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.348189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.348827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:07:28.349135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.350758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.353073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1220/2459] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:28 2022] DELETE /identity/v3/users/069b3d8ccba24a5aacad5401d9c2e17d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:28.371049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1240/2460] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:07:28.372198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.434268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00818a3-b475-4a92-a767-2b33ad016068 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.439463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.440073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.440349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.440616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.441250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.443166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.472521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1221/2461] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:28 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:28.477016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.489649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f13c1-ea00-44c5-b248-6877e27ca9cd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.539222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.541385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:28.547512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:28.556763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.558151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.558640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.558995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.559971 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.562476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.587198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1241/2462] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:28 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:28.590820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.594543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:28.601651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c195b4-308a-4b35-ba34-33523bb1ccbb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.606774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.607376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.607665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.607941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.608649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.610293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.621127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1242/2463] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:07:28.625700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.635525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df0b3b-39fd-4c9c-8ad6-610b1ae84f4e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.635701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8064a4d-d1ba-4e61-afb8-8c5483258167 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.640953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.641738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.641876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.641876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.642049 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.642192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] PATH_INFO: `/v3/projects/381fe137aec44396aa20c6e76734f795` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.642383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.642656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.643251 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=381fe137aec44396aa20c6e76734f795)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.643368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.644852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.645147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.655432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1243/2464] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:07:28.659609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.668996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ed02-9791-46ec-9841-8c9a00aa5023 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.674544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787e992-38d0-4bc2-83e1-60049a08c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:28.675220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e992-38d0-4bc2-83e1-60049a08c032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.675500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e992-38d0-4bc2-83e1-60049a08c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.675775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e992-38d0-4bc2-83e1-60049a08c032 admin admin] PATH_INFO: `/v3/projects/ee2f1f9546c045cebe9cc9e5364d98fb/users/2bc608ffa65944b98b1e5969888b0766/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.700004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e992-38d0-4bc2-83e1-60049a08c032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2f1f9546c045cebe9cc9e5364d98fb, user_id=2bc608ffa65944b98b1e5969888b0766, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:28.700004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787e992-38d0-4bc2-83e1-60049a08c032 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:28.705823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381fe137aec44396aa20c6e76734f795', 'request_id': 'req-d5eccd8e-f7ab-4815-8787-2ef510c846c5'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.713280 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1244/2465] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:28 2022] PUT /identity/v3/projects/ee2f1f9546c045cebe9cc9e5364d98fb/users/2bc608ffa65944b98b1e5969888b0766/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:07:28.714143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381fe137aec44396aa20c6e76734f795', 'request_id': 'req-d5eccd8e-f7ab-4815-8787-2ef510c846c5'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.720900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381fe137aec44396aa20c6e76734f795', 'request_id': 'req-d5eccd8e-f7ab-4815-8787-2ef510c846c5'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.723972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:28.724257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:28.724523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:28.731827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] The token cache is being invalidate because project 381fe137aec44396aa20c6e76734f795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:28.732121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.732793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:28.735031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1222/2466] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:28 2022] DELETE /identity/v3/projects/381fe137aec44396aa20c6e76734f795 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:07:28.755415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] MFA Rules not processed for user `2bc608ffa65944b98b1e5969888b0766`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:28.756788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:28.828928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1245/2467] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:07:28.840719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:28.842355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:28.948785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eccd8e-f7ab-4815-8787-2ef510c846c5 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:28.985299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:29.016989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3918051-ad05-46fd-91cf-5f1d6e82efc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:29.017593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3918051-ad05-46fd-91cf-5f1d6e82efc9 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:29.017872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3918051-ad05-46fd-91cf-5f1d6e82efc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:29.018189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3918051-ad05-46fd-91cf-5f1d6e82efc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:29.025817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3918051-ad05-46fd-91cf-5f1d6e82efc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:29.027425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3918051-ad05-46fd-91cf-5f1d6e82efc9 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:29.036391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1223/2468] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:31.702762 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:31.704463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:31.768553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60867840-3e6d-415f-b40b-b1063b4f854d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:31.773017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:31.773629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:31.773905 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:31.774201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] PATH_INFO: `/v3/users/2bc608ffa65944b98b1e5969888b0766` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:31.775320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc608ffa65944b98b1e5969888b0766)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:31.777230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:31.808481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:31.828189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc608ffa65944b98b1e5969888b0766'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:31.835221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc608ffa65944b98b1e5969888b0766'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:31.847352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc608ffa65944b98b1e5969888b0766'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:31.848001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc608ffa65944b98b1e5969888b0766'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:31.854730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc608ffa65944b98b1e5969888b0766'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:31.860997 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1246/2469] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:31 2022] DELETE /identity/v3/users/2bc608ffa65944b98b1e5969888b0766 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:31.866060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:31.866547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:31.866659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:31.886015 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:31.887235 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:31.945548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1224/2470] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:31.955377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:31.956753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:32.012751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185bee9-25f7-48aa-b29e-fe1e432dd21a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.016374 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e7189-e6de-480e-b191-f0b455dbee64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.016967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7189-e6de-480e-b191-f0b455dbee64 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.017244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7189-e6de-480e-b191-f0b455dbee64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.017513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e7189-e6de-480e-b191-f0b455dbee64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.026436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e7189-e6de-480e-b191-f0b455dbee64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.027851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e7189-e6de-480e-b191-f0b455dbee64 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.037641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1247/2471] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:32.310996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:32.312545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:32.335083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14903fba-4a2e-4868-8dfc-19fe037da8b3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.340081 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.340707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.340980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.341246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] PATH_INFO: `/v3/projects/ee2f1f9546c045cebe9cc9e5364d98fb` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.342415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2f1f9546c045cebe9cc9e5364d98fb)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.345118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.390639 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2f1f9546c045cebe9cc9e5364d98fb', 'request_id': 'req-06ab768f-1ea0-40a5-86df-4bb90e184f02'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:32.398424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2f1f9546c045cebe9cc9e5364d98fb', 'request_id': 'req-06ab768f-1ea0-40a5-86df-4bb90e184f02'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:32.404441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2f1f9546c045cebe9cc9e5364d98fb', 'request_id': 'req-06ab768f-1ea0-40a5-86df-4bb90e184f02'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:32.415124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] The token cache is being invalidate because project ee2f1f9546c045cebe9cc9e5364d98fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:32.415405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:32.416024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-06ab768f-1ea0-40a5-86df-4bb90e184f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:32.417476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1225/2472] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:32 2022] DELETE /identity/v3/projects/ee2f1f9546c045cebe9cc9e5364d98fb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:32.423041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912376a2-1906-4f1a-9cff-53120ac61111 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.423326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912376a2-1906-4f1a-9cff-53120ac61111 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.423599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912376a2-1906-4f1a-9cff-53120ac61111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.442996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-912376a2-1906-4f1a-9cff-53120ac61111 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:32.444183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-912376a2-1906-4f1a-9cff-53120ac61111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:32.503900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1248/2473] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:32.511454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e812c-8f5d-4e92-9d35-74798abe3993 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.511738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e812c-8f5d-4e92-9d35-74798abe3993 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.512011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e812c-8f5d-4e92-9d35-74798abe3993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.532394 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d60e812c-8f5d-4e92-9d35-74798abe3993 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:32.533600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d60e812c-8f5d-4e92-9d35-74798abe3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:32.541432 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1226/2474] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:32.545491 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912376a2-1906-4f1a-9cff-53120ac61111 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:32.555035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912376a2-1906-4f1a-9cff-53120ac61111 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.559556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.560145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.560425 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.560697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.561398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:07:32.561875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.563249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.574790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1249/2475] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:07:32.579398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e812c-8f5d-4e92-9d35-74798abe3993 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:32.588478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e812c-8f5d-4e92-9d35-74798abe3993 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.593635 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.594302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.594579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.594845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.595523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.597401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.623466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1227/2476] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:32 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:32.628046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:32.637915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd72a9-15ff-43fd-a41c-9f80eb6adbe9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.669941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:32.699166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.699773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.700115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.700327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.700954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.703574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.724862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1250/2477] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:32 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:32.729062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:32.739706 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12954a3-1f84-4d31-ac24-18e052dbfd57 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.744276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.744865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.745143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.745415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.746049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.747692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.757580 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1228/2478] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:07:32.761326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:32.771879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154606a-1a4c-4768-bb05-913f65648cbd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.776412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74d40a-4005-4ee2-ad8a-3784f3c2d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.776992 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74d40a-4005-4ee2-ad8a-3784f3c2d9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.777268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74d40a-4005-4ee2-ad8a-3784f3c2d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.777535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74d40a-4005-4ee2-ad8a-3784f3c2d9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.778194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74d40a-4005-4ee2-ad8a-3784f3c2d9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.779767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74d40a-4005-4ee2-ad8a-3784f3c2d9d3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.790936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1251/2479] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:32.794931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:32.804879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107c1a5-d492-44c0-ab80-c50d4739b99a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:32.809544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:32.810207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.810507 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.810776 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] PATH_INFO: `/v3/projects/663fcc50f3c341d69aa21680bdbb125c/users/4a753baf297543e5bd4641f54f2df2ca/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.813032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:32.828442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=663fcc50f3c341d69aa21680bdbb125c, user_id=4a753baf297543e5bd4641f54f2df2ca, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:32.831122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:32.844165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1229/2480] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:32 2022] PUT /identity/v3/projects/663fcc50f3c341d69aa21680bdbb125c/users/4a753baf297543e5bd4641f54f2df2ca/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:32.855566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf13329-a04d-4bf0-a0dc-1f54776784c1 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:32.855849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf13329-a04d-4bf0-a0dc-1f54776784c1 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:32.856120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf13329-a04d-4bf0-a0dc-1f54776784c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:32.883943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8bf13329-a04d-4bf0-a0dc-1f54776784c1 None None] MFA Rules not processed for user `4a753baf297543e5bd4641f54f2df2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:32.885131 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8bf13329-a04d-4bf0-a0dc-1f54776784c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:32.948803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1252/2481] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:32.953476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.013977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6dba8d-34fd-4b64-9eb4-27d12fc82acc admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.018803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.019392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.019668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.019937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.020557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.022463 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.049268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1230/2482] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:32 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:33.053249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf13329-a04d-4bf0-a0dc-1f54776784c1 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.063825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf13329-a04d-4bf0-a0dc-1f54776784c1 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.120286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.120887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.121176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.121433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.122070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.124044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.143799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1253/2483] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:33 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:33.147770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.158552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b93ce-b49d-43ed-ad15-c377cc718f17 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.163097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.163679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.163957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.164229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.164849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.166462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.177701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1231/2484] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:33.181797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.191866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252610f-b3b9-42c9-b510-b1f4e929ad91 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.196452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.197355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.197632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.197903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] PATH_INFO: `/v3/projects/5d457a69aff14e16b6ce4a2e2766b036/users/0e0b5370e5c245c58070b7677cc0e74a/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.212671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d457a69aff14e16b6ce4a2e2766b036, user_id=0e0b5370e5c245c58070b7677cc0e74a, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.215317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.228333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1254/2485] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:33 2022] PUT /identity/v3/projects/5d457a69aff14e16b6ce4a2e2766b036/users/0e0b5370e5c245c58070b7677cc0e74a/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:33.232269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.242674 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8134e-aefb-4815-80a1-0d87001cb839 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.297989 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bcffc-70ee-4aa6-a80f-9666ae19a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.298537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bcffc-70ee-4aa6-a80f-9666ae19a526 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.298829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bcffc-70ee-4aa6-a80f-9666ae19a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.299076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bcffc-70ee-4aa6-a80f-9666ae19a526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.299694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bcffc-70ee-4aa6-a80f-9666ae19a526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.301294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bcffc-70ee-4aa6-a80f-9666ae19a526 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.310694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1232/2486] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:33.314946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.325515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acb8cc-3f52-46f9-ad46-966f57d1687b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.330659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.331296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.331570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.331837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] PATH_INFO: `/v3/projects/5d457a69aff14e16b6ce4a2e2766b036/users/0e0b5370e5c245c58070b7677cc0e74a/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.333665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d457a69aff14e16b6ce4a2e2766b036, user_id=0e0b5370e5c245c58070b7677cc0e74a, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.336318 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.339308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:33.348282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1255/2487] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:33 2022] PUT /identity/v3/projects/5d457a69aff14e16b6ce4a2e2766b036/users/0e0b5370e5c245c58070b7677cc0e74a/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:33.358643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.358930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.359204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.386536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] MFA Rules not processed for user `0e0b5370e5c245c58070b7677cc0e74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:33.387757 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:33.428532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:33.456150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1233/2488] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:33.466668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.469110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:33.546606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8676d-eb3c-4806-a8ae-ecb8bf1cdbf6 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.550289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.550819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.551094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.551364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.560287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.561721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.571234 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1256/2489] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:33.617546 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:33.618931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:33.631068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3144772-bddb-4228-ba6b-584bca6488f4 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:33.634573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baa0a6-5488-4dac-a5b8-b6865495fc65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:33.635160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baa0a6-5488-4dac-a5b8-b6865495fc65 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:33.635434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baa0a6-5488-4dac-a5b8-b6865495fc65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:33.635701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baa0a6-5488-4dac-a5b8-b6865495fc65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:33.692104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baa0a6-5488-4dac-a5b8-b6865495fc65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:33.693533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baa0a6-5488-4dac-a5b8-b6865495fc65 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:33.704188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1234/2490] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:36.973505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:37.036087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef356fd7-ac0b-4e1b-a140-2adbec208740 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:37.040668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:37.041285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:37.041569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:37.041843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] PATH_INFO: `/v3/users/4a753baf297543e5bd4641f54f2df2ca` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:37.042979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a753baf297543e5bd4641f54f2df2ca)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:37.045198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:37.090529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a753baf297543e5bd4641f54f2df2ca'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.097939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a753baf297543e5bd4641f54f2df2ca'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.110500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a753baf297543e5bd4641f54f2df2ca'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.111140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a753baf297543e5bd4641f54f2df2ca'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.117897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a753baf297543e5bd4641f54f2df2ca'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.119479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:37.131579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1257/2491] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:36 2022] DELETE /identity/v3/users/4a753baf297543e5bd4641f54f2df2ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:37.136176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:37.136649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:37.136882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:37.155642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:37.156981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:37.216575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1235/2492] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:07:37.226380 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:37.227779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:37.287156 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f480f0-6441-44db-b520-6f621e1118da admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:37.290844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:37.291440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:37.291720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:37.291990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:37.300897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:37.302369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:37.312947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1258/2493] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:37.583567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:37.585062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:37.597718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdfe5b-bcf7-4744-b75b-e0eb9c6713ad None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:37.602669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:37.603378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:37.603849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:37.604672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] PATH_INFO: `/v3/projects/663fcc50f3c341d69aa21680bdbb125c` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:37.606261 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=663fcc50f3c341d69aa21680bdbb125c)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:37.608726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:37.656418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663fcc50f3c341d69aa21680bdbb125c', 'request_id': 'req-89c385ad-87f5-4342-8d42-0984e9199e5b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.663620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663fcc50f3c341d69aa21680bdbb125c', 'request_id': 'req-89c385ad-87f5-4342-8d42-0984e9199e5b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.669853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663fcc50f3c341d69aa21680bdbb125c', 'request_id': 'req-89c385ad-87f5-4342-8d42-0984e9199e5b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.676962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:37.681100 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] The token cache is being invalidate because project 663fcc50f3c341d69aa21680bdbb125c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:37.681395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.682477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.684537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1236/2494] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:37 2022] DELETE /identity/v3/projects/663fcc50f3c341d69aa21680bdbb125c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:37.689414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:37.699447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d0a4-1497-476f-a1fb-025375a106aa service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:37.755764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:37.756305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:37.756582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:37.756852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] PATH_INFO: `/v3/users/0e0b5370e5c245c58070b7677cc0e74a` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:37.757958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0b5370e5c245c58070b7677cc0e74a)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:37.759902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:37.804649 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0b5370e5c245c58070b7677cc0e74a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.811882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0b5370e5c245c58070b7677cc0e74a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.825729 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0b5370e5c245c58070b7677cc0e74a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.826482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0b5370e5c245c58070b7677cc0e74a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.833488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e3cca6ab-f936-4256-9edd-b704de16098a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0b5370e5c245c58070b7677cc0e74a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:37.839427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1259/2495] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:37 2022] DELETE /identity/v3/users/0e0b5370e5c245c58070b7677cc0e74a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:38.118715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.120234 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:38.138800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c385ad-87f5-4342-8d42-0984e9199e5b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.197297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.197919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.198229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.198504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] PATH_INFO: `/v3/projects/5d457a69aff14e16b6ce4a2e2766b036` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.199602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d457a69aff14e16b6ce4a2e2766b036)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.201481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.248144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d457a69aff14e16b6ce4a2e2766b036', 'request_id': 'req-047742ea-7140-460f-8b18-0c644e3f9428'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:38.255586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d457a69aff14e16b6ce4a2e2766b036', 'request_id': 'req-047742ea-7140-460f-8b18-0c644e3f9428'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:38.262298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d457a69aff14e16b6ce4a2e2766b036', 'request_id': 'req-047742ea-7140-460f-8b18-0c644e3f9428'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:38.273193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] The token cache is being invalidate because project 5d457a69aff14e16b6ce4a2e2766b036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:38.273481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:38.274143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-047742ea-7140-460f-8b18-0c644e3f9428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:38.275648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1237/2496] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:38 2022] DELETE /identity/v3/projects/5d457a69aff14e16b6ce4a2e2766b036 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:38.280592 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a151d-f2e6-4fc9-993b-5892df9c6f24 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.281632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a151d-f2e6-4fc9-993b-5892df9c6f24 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.281980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a151d-f2e6-4fc9-993b-5892df9c6f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.302124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a50a151d-f2e6-4fc9-993b-5892df9c6f24 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:38.303285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a50a151d-f2e6-4fc9-993b-5892df9c6f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:38.316368 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:38.365040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1260/2497] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:38.372651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59029-5e9e-4e3a-a29d-4f51a9d6681e None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.372935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59029-5e9e-4e3a-a29d-4f51a9d6681e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.373213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e59029-5e9e-4e3a-a29d-4f51a9d6681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.392914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-07e59029-5e9e-4e3a-a29d-4f51a9d6681e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:38.394139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-07e59029-5e9e-4e3a-a29d-4f51a9d6681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:38.402232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1238/2498] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:38.407051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a151d-f2e6-4fc9-993b-5892df9c6f24 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.416677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a151d-f2e6-4fc9-993b-5892df9c6f24 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.421180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.422396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.422687 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.423064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.423707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:07:38.424008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.425594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.436988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1261/2499] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:07:38.441552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59029-5e9e-4e3a-a29d-4f51a9d6681e None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.451054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e59029-5e9e-4e3a-a29d-4f51a9d6681e None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.456320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.456913 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.457193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.457466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.458129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.460029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.487691 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1239/2500] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:38 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:38.491814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.501828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f7198-5dbe-4934-a917-74fbe2350f40 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.558517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.559042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.559321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.559593 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.560225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.562251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.583700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1262/2501] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:38 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:38.587798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.598979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315edf35-19bd-4178-88bb-6c3bda0ae6c1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.603505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.604095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.604373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.604644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.605279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.606894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.616821 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1240/2502] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:38.620570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.630739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2508095-02e0-4ead-9838-29525278209d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.635285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc6343-0b5e-49ec-922f-bdecefb36d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.635873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6343-0b5e-49ec-922f-bdecefb36d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.636150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6343-0b5e-49ec-922f-bdecefb36d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.636417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc6343-0b5e-49ec-922f-bdecefb36d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.637128 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6343-0b5e-49ec-922f-bdecefb36d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.638779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc6343-0b5e-49ec-922f-bdecefb36d19 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.650184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1263/2503] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:38.654243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.664792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81564b0-8cf2-4dd2-99ed-4c2e73bf422f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.669425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.670008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.670306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.670576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] PATH_INFO: `/v3/projects/84c1f8159cc44255bf4f2f6c58e62b0f/users/9f1c24edd4f64a369956e044dc5d3573/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.687311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c1f8159cc44255bf4f2f6c58e62b0f, user_id=9f1c24edd4f64a369956e044dc5d3573, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.688545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.704798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1241/2504] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:38 2022] PUT /identity/v3/projects/84c1f8159cc44255bf4f2f6c58e62b0f/users/9f1c24edd4f64a369956e044dc5d3573/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:38.716487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4022f81-2abb-4dd9-b3cc-19b3efd06c0d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.716769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4022f81-2abb-4dd9-b3cc-19b3efd06c0d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.717041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4022f81-2abb-4dd9-b3cc-19b3efd06c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.745152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d4022f81-2abb-4dd9-b3cc-19b3efd06c0d None None] MFA Rules not processed for user `9f1c24edd4f64a369956e044dc5d3573`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:38.746375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d4022f81-2abb-4dd9-b3cc-19b3efd06c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:38.809376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1264/2505] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:38.814418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.844344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:38.877675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d04bbd-b146-4448-b9c3-32e1a7f42579 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.882485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.883089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.883363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.883633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.884260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.886508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:38.914343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1242/2506] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:38 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:38.918261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4022f81-2abb-4dd9-b3cc-19b3efd06c0d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:38.929243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4022f81-2abb-4dd9-b3cc-19b3efd06c0d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:38.941102 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:38.986621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:38.987226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:38.987502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:38.987772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:38.988403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:38.990349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:39.011664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1265/2507] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:38 2022] POST /identity/v3/users => generated 310 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:39.016429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:39.026717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6dc6e-73a8-48c3-bdbb-cddc9af2f177 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:39.031523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:39.032142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:39.032421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:39.033321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:39.033960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:39.035573 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:39.045772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1243/2508] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:39.049958 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:39.059995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37340c0b-776f-4d24-a7d4-1016eac4212c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:39.065177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:39.065817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:39.066113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:39.066399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] PATH_INFO: `/v3/projects/ab18b00ec72849009903f741cbbf34ff/users/a57ca6bcec2f47f0ab39069d42f464d3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:39.083076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab18b00ec72849009903f741cbbf34ff, user_id=a57ca6bcec2f47f0ab39069d42f464d3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:39.085696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:39.098635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1266/2509] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:39 2022] PUT /identity/v3/projects/ab18b00ec72849009903f741cbbf34ff/users/a57ca6bcec2f47f0ab39069d42f464d3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:39.102768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:39.113010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef139e-a165-4450-aafd-ef45f8bea80c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:39.169070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a124-6f1e-4ddb-a154-9123fe495942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:39.170030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a124-6f1e-4ddb-a154-9123fe495942 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:39.170030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a124-6f1e-4ddb-a154-9123fe495942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:39.170302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a124-6f1e-4ddb-a154-9123fe495942 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:39.171090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a124-6f1e-4ddb-a154-9123fe495942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:39.172872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a124-6f1e-4ddb-a154-9123fe495942 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:39.182768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1244/2510] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:39.187033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:39.198009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56865f5a-1b34-4bba-a42b-73bfbb315b97 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:39.202595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:39.203809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:39.204081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:39.204350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] PATH_INFO: `/v3/projects/ab18b00ec72849009903f741cbbf34ff/users/a57ca6bcec2f47f0ab39069d42f464d3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:39.206267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab18b00ec72849009903f741cbbf34ff, user_id=a57ca6bcec2f47f0ab39069d42f464d3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:39.208861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:39.218910 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1267/2511] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:39 2022] PUT /identity/v3/projects/ab18b00ec72849009903f741cbbf34ff/users/a57ca6bcec2f47f0ab39069d42f464d3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:39.229016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08670e-7951-4e61-9faa-4850446e38a3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:39.229301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08670e-7951-4e61-9faa-4850446e38a3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:39.229569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08670e-7951-4e61-9faa-4850446e38a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:39.258011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-4e08670e-7951-4e61-9faa-4850446e38a3 None None] MFA Rules not processed for user `a57ca6bcec2f47f0ab39069d42f464d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:39.259232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-4e08670e-7951-4e61-9faa-4850446e38a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:39.324651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1245/2512] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:39 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:39.335224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:39.337087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:39.394329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aed58-b489-444e-bd32-bb504256fac2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:39.397982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:39.398579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:39.398855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:39.399420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:39.408461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:39.409873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:39.419620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1268/2513] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:39.567665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08670e-7951-4e61-9faa-4850446e38a3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:39.577343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08670e-7951-4e61-9faa-4850446e38a3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:39.580799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88a70b-8729-4434-81c4-ff60ab123328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:39.581393 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88a70b-8729-4434-81c4-ff60ab123328 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:39.581668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88a70b-8729-4434-81c4-ff60ab123328 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:39.581937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88a70b-8729-4434-81c4-ff60ab123328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:39.601840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:39.644009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88a70b-8729-4434-81c4-ff60ab123328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:39.645445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88a70b-8729-4434-81c4-ff60ab123328 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:39.654294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1246/2514] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:39 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:44.895771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:44.960199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f23f8-a017-4366-b836-a53bef04a66b service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:44.964767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:44.965391 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:44.965666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:44.965935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] PATH_INFO: `/v3/users/9f1c24edd4f64a369956e044dc5d3573` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:44.967081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1c24edd4f64a369956e044dc5d3573)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:44.969013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:44.981165 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:45.014530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1c24edd4f64a369956e044dc5d3573'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.022287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1c24edd4f64a369956e044dc5d3573'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.034764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1c24edd4f64a369956e044dc5d3573'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.035387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1c24edd4f64a369956e044dc5d3573'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.042261 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1c24edd4f64a369956e044dc5d3573'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.048010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1269/2515] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:44 2022] DELETE /identity/v3/users/9f1c24edd4f64a369956e044dc5d3573 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:45.052499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:45.052982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:45.053107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:45.072314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:45.073500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:45.131385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1247/2516] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:45.141119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:45.142654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:45.200758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b2685-d662-4506-94ed-fca53dacf231 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:45.204898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:45.205499 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:45.205777 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:45.206051 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:45.215074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:45.216521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:45.226820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1270/2517] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:45.746951 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:45.748401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:45.760983 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89c09f-e0b1-4857-80da-a3d90e056261 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:45.765734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:45.767003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:45.767485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:45.767763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] PATH_INFO: `/v3/projects/84c1f8159cc44255bf4f2f6c58e62b0f` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:45.768904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c1f8159cc44255bf4f2f6c58e62b0f)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:45.771002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:45.817144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c1f8159cc44255bf4f2f6c58e62b0f', 'request_id': 'req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.824228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c1f8159cc44255bf4f2f6c58e62b0f', 'request_id': 'req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.831329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c1f8159cc44255bf4f2f6c58e62b0f', 'request_id': 'req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.841610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] The token cache is being invalidate because project 84c1f8159cc44255bf4f2f6c58e62b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:45.842061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.842642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.844385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1248/2518] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:45 2022] DELETE /identity/v3/projects/84c1f8159cc44255bf4f2f6c58e62b0f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:45.848562 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:45.858604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355da48d-86c5-42fd-b7eb-1fc968c78708 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:45.913572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:45.914228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:45.914502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:45.914773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] PATH_INFO: `/v3/users/a57ca6bcec2f47f0ab39069d42f464d3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:45.915882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57ca6bcec2f47f0ab39069d42f464d3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:45.917791 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:45.955508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:45.965822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57ca6bcec2f47f0ab39069d42f464d3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.974105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57ca6bcec2f47f0ab39069d42f464d3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.987725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57ca6bcec2f47f0ab39069d42f464d3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.988354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57ca6bcec2f47f0ab39069d42f464d3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:45.995067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e8bb6632-46aa-498d-bf88-defa72e963a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57ca6bcec2f47f0ab39069d42f464d3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:46.001388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1271/2519] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:45 2022] DELETE /identity/v3/users/a57ca6bcec2f47f0ab39069d42f464d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:46.270650 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:46.272214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:46.285630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51dd8f-d41b-46e5-a8a7-2a64683fde7c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:46.330918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:46.350624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:46.351255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.351558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.351826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] PATH_INFO: `/v3/projects/ab18b00ec72849009903f741cbbf34ff` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.352939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab18b00ec72849009903f741cbbf34ff)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:46.354916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:46.400225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab18b00ec72849009903f741cbbf34ff', 'request_id': 'req-46e6d893-0926-40f3-ab74-1e6a77d5dd20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:46.407250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab18b00ec72849009903f741cbbf34ff', 'request_id': 'req-46e6d893-0926-40f3-ab74-1e6a77d5dd20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:46.413945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab18b00ec72849009903f741cbbf34ff', 'request_id': 'req-46e6d893-0926-40f3-ab74-1e6a77d5dd20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:46.425003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] The token cache is being invalidate because project ab18b00ec72849009903f741cbbf34ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:46.425291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:46.425920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-46e6d893-0926-40f3-ab74-1e6a77d5dd20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:46.427438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1249/2520] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:46 2022] DELETE /identity/v3/projects/ab18b00ec72849009903f741cbbf34ff => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:46.432591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138e76-8132-4f1c-8358-a1073c4c6dec None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.432878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138e76-8132-4f1c-8358-a1073c4c6dec None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.433152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33138e76-8132-4f1c-8358-a1073c4c6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.452787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-33138e76-8132-4f1c-8358-a1073c4c6dec None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:46.454492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-33138e76-8132-4f1c-8358-a1073c4c6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:46.513640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1272/2521] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:46.523437 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ad93-fd7c-43b8-a8dc-bfe1b559b8e3 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.523775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ad93-fd7c-43b8-a8dc-bfe1b559b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.524085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249ad93-fd7c-43b8-a8dc-bfe1b559b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.544110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-1249ad93-fd7c-43b8-a8dc-bfe1b559b8e3 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:46.545324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1249ad93-fd7c-43b8-a8dc-bfe1b559b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:46.553360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1250/2522] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:46.557607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33138e76-8132-4f1c-8358-a1073c4c6dec None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:46.567829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33138e76-8132-4f1c-8358-a1073c4c6dec None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:46.572837 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:46.573439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.573719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.573990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.574690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:07:46.574990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:46.576680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:46.588868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1273/2523] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:07:46.593004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ad93-fd7c-43b8-a8dc-bfe1b559b8e3 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:46.602323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249ad93-fd7c-43b8-a8dc-bfe1b559b8e3 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:46.606985 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:46.607577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.607855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.608149 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.608784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:46.610749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:46.647326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1251/2524] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:46 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:46.651398 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:46.661585 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d63cc-72f3-40de-9f98-752c822043b7 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:46.718252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:46.718800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.719081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.719366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.720074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:46.722026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:46.743475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1274/2525] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:46 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:07:46.747653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:46.758549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099efa4-d461-4e86-b9bd-75d7946f3950 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:46.763165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:46.763758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.764036 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.764311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.764943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:46.766564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:46.776368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1252/2526] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:46.780152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:46.790258 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7d60b-0056-4bf7-b169-2673be05bfef admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:46.794966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181477bd-fb94-48ad-a26c-70845fc9451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:46.795544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181477bd-fb94-48ad-a26c-70845fc9451a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.795820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181477bd-fb94-48ad-a26c-70845fc9451a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.796087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181477bd-fb94-48ad-a26c-70845fc9451a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.796720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181477bd-fb94-48ad-a26c-70845fc9451a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:46.798969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181477bd-fb94-48ad-a26c-70845fc9451a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:46.809267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1275/2527] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:46.813408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:46.823527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae68aaf-e1f9-41c0-bcf4-d4e29d5f5221 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:46.828116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:46.829272 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.829552 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.829827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] PATH_INFO: `/v3/projects/5d8d3583790c480c92a969723f4518a5/users/723c49e9045c4ba3a14122a6b8d2fe24/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.845641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8d3583790c480c92a969723f4518a5, user_id=723c49e9045c4ba3a14122a6b8d2fe24, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:46.848578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:46.861653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1253/2528] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:46 2022] PUT /identity/v3/projects/5d8d3583790c480c92a969723f4518a5/users/723c49e9045c4ba3a14122a6b8d2fe24/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:46.871701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e3aa4-3f1a-4ac8-ba9c-ea8523f89c78 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:46.871986 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e3aa4-3f1a-4ac8-ba9c-ea8523f89c78 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:46.872253 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e3aa4-3f1a-4ac8-ba9c-ea8523f89c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:46.901237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-189e3aa4-3f1a-4ac8-ba9c-ea8523f89c78 None None] MFA Rules not processed for user `723c49e9045c4ba3a14122a6b8d2fe24`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:46.902447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-189e3aa4-3f1a-4ac8-ba9c-ea8523f89c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:46.908104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:46.967702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1276/2529] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:46.973060 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.033949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9fcad-ada8-4784-9b21-2cb704b09951 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.038579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.039167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.039442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.039708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.040331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.042222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.047399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:47.069877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1254/2530] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:46 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:07:47.074242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e3aa4-3f1a-4ac8-ba9c-ea8523f89c78 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.085486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e3aa4-3f1a-4ac8-ba9c-ea8523f89c78 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.139942 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.140544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.140823 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.141100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.142426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.144333 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.164222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1277/2531] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:47 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:47.168300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.179069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c693-d749-4d72-b652-ea825c36b576 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.183597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.184184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.184460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.184727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.185353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.186967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.197562 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1255/2532] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:47.201438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.212331 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8269ba9-52fb-4581-80ce-dd12446526ff admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.216813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57ad36-3fe0-408d-a101-bd3802f5029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.217393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57ad36-3fe0-408d-a101-bd3802f5029a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.217664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57ad36-3fe0-408d-a101-bd3802f5029a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.217929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57ad36-3fe0-408d-a101-bd3802f5029a admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.218590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57ad36-3fe0-408d-a101-bd3802f5029a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.220435 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57ad36-3fe0-408d-a101-bd3802f5029a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.230384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1278/2533] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:47.234184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.244390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75b3c0-bf2a-4451-9781-1971a0fff4b3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.248912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.249566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.249838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.250124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] PATH_INFO: `/v3/projects/e183b124fc424b97a9fea9754d57f80d/users/36ec14ae328646a399afa1c0fd2d3d0d/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.264846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e183b124fc424b97a9fea9754d57f80d, user_id=36ec14ae328646a399afa1c0fd2d3d0d, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.268142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.280465 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1256/2534] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:47 2022] PUT /identity/v3/projects/e183b124fc424b97a9fea9754d57f80d/users/36ec14ae328646a399afa1c0fd2d3d0d/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:07:47.290793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a851c-2328-4cdd-b31f-1e281efd815a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.291067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a851c-2328-4cdd-b31f-1e281efd815a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.291335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a851c-2328-4cdd-b31f-1e281efd815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.318850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-100a851c-2328-4cdd-b31f-1e281efd815a None None] MFA Rules not processed for user `36ec14ae328646a399afa1c0fd2d3d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:47.320035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-100a851c-2328-4cdd-b31f-1e281efd815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:47.383671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1279/2535] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:47.388075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.450258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302b80-ac56-41b9-b928-d035d67852cb admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.454973 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.455570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.455848 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.456204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.456761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.458667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.485311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1257/2536] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:47 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:47.489304 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a851c-2328-4cdd-b31f-1e281efd815a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.499790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a851c-2328-4cdd-b31f-1e281efd815a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.511756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:47.557055 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.557656 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.557936 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.558242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.558880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.560785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.582848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1280/2537] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:47 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:47.586806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.597017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60e8a4-d851-456f-b369-170c06a9e5a2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.601555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.602166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.602448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.602721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.603354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.604931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.736934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1258/2538] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:47.741287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.752262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d7d7c-fd88-4664-b429-d7f3c822e348 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.756835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.757470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.757745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.758016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] PATH_INFO: `/v3/projects/634076f82f8243b9b75dba6ccf7b1d94/users/9b1a787bd4ef44f1914e81ca31e55ea0/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.772839 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=634076f82f8243b9b75dba6ccf7b1d94, user_id=9b1a787bd4ef44f1914e81ca31e55ea0, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.775535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.788709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1281/2539] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:47 2022] PUT /identity/v3/projects/634076f82f8243b9b75dba6ccf7b1d94/users/9b1a787bd4ef44f1914e81ca31e55ea0/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:47.792678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.803093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022de19-d435-437a-a5e7-11be49629d95 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.858441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf2aaa-fa97-4e5d-b8d0-0ac7e7cd75cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.859038 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf2aaa-fa97-4e5d-b8d0-0ac7e7cd75cb admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.859319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf2aaa-fa97-4e5d-b8d0-0ac7e7cd75cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.859589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf2aaa-fa97-4e5d-b8d0-0ac7e7cd75cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.860225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf2aaa-fa97-4e5d-b8d0-0ac7e7cd75cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.861893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf2aaa-fa97-4e5d-b8d0-0ac7e7cd75cb admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.872392 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1259/2540] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:47.877239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:47.887650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22d6f2-1d71-4ef7-a36c-5eb84bb6faaa admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:47.892906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:47.893548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.893826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.894123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] PATH_INFO: `/v3/projects/634076f82f8243b9b75dba6ccf7b1d94/users/9b1a787bd4ef44f1914e81ca31e55ea0/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.896092 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634076f82f8243b9b75dba6ccf7b1d94, user_id=9b1a787bd4ef44f1914e81ca31e55ea0, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:47.898756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:47.909063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1282/2541] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:47 2022] PUT /identity/v3/projects/634076f82f8243b9b75dba6ccf7b1d94/users/9b1a787bd4ef44f1914e81ca31e55ea0/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:47.919946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:47.920230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:47.920500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:47.948749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] MFA Rules not processed for user `9b1a787bd4ef44f1914e81ca31e55ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:47.949950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:47.959960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:48.018902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1260/2542] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:48.029760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:48.031474 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:48.088112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc262950-4bfc-48e4-a3ef-18e11e2d6351 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:48.092492 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:48.092967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:48.093201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:48.093437 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:48.104847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:48.106565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:48.116697 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1283/2543] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:48.158230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:48.159613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:48.171770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55282b7-33e6-4e17-84c3-623b79d833f5 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:48.176219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6f517-3040-4c2f-882a-12f6d0f317d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:48.176816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f517-3040-4c2f-882a-12f6d0f317d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:48.177087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f517-3040-4c2f-882a-12f6d0f317d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:48.177353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6f517-3040-4c2f-882a-12f6d0f317d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:48.232873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6f517-3040-4c2f-882a-12f6d0f317d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:48.234321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6f517-3040-4c2f-882a-12f6d0f317d3 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:48.243498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1261/2544] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:51.106329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:51.169424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5084165-89f8-417c-8659-f1f85743fda2 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:51.175353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:51.175989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:51.176268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:51.176538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] PATH_INFO: `/v3/users/723c49e9045c4ba3a14122a6b8d2fe24` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:51.177683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=723c49e9045c4ba3a14122a6b8d2fe24)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:51.179639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:51.192142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:51.225825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723c49e9045c4ba3a14122a6b8d2fe24'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.232879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723c49e9045c4ba3a14122a6b8d2fe24'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.244889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723c49e9045c4ba3a14122a6b8d2fe24'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.245528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723c49e9045c4ba3a14122a6b8d2fe24'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.252557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723c49e9045c4ba3a14122a6b8d2fe24'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.258340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1284/2545] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:51 2022] DELETE /identity/v3/users/723c49e9045c4ba3a14122a6b8d2fe24 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:51.262803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:51.263303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:51.263419 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:51.283057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:51.284476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:51.344082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1262/2546] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:51.353862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:51.355624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:51.414042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84cdfb-4759-492b-8ab9-cf17ec890a0a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:51.417730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:51.418364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:51.418647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:51.418924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:51.428560 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:51.429990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:51.439970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1285/2547] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:51.719241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:51.720996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:51.733591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2eeb16-18b9-4722-9c06-1f617deca01c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:51.740934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:51.741147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:51.741483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:51.741752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] PATH_INFO: `/v3/projects/5d8d3583790c480c92a969723f4518a5` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:51.742931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8d3583790c480c92a969723f4518a5)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:51.744970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:51.791361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:51.798766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8d3583790c480c92a969723f4518a5', 'request_id': 'req-17c13a86-c482-4197-9cbb-863e792a5ed7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.806365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8d3583790c480c92a969723f4518a5', 'request_id': 'req-17c13a86-c482-4197-9cbb-863e792a5ed7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.811955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:51.813806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8d3583790c480c92a969723f4518a5', 'request_id': 'req-17c13a86-c482-4197-9cbb-863e792a5ed7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.814330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:51.825043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] The token cache is being invalidate because project 5d8d3583790c480c92a969723f4518a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:51.825414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.826168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.827709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1263/2548] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:51 2022] DELETE /identity/v3/projects/5d8d3583790c480c92a969723f4518a5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:51.832207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:51.833527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:51.874695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ad54-360d-4347-973e-b07815d83fca service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:51.901711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c13a86-c482-4197-9cbb-863e792a5ed7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:51.906550 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:51.907200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:51.907483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:51.907754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] PATH_INFO: `/v3/users/36ec14ae328646a399afa1c0fd2d3d0d` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:51.908901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ec14ae328646a399afa1c0fd2d3d0d)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:51.910884 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:51.921628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:51.927650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:51.928397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:51.929009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:51.929606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:51.932289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:51.960265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ec14ae328646a399afa1c0fd2d3d0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.968685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ec14ae328646a399afa1c0fd2d3d0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.970049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ec14ae328646a399afa1c0fd2d3d0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.977347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ec14ae328646a399afa1c0fd2d3d0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.989161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ec14ae328646a399afa1c0fd2d3d0d'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:51.995168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1264/2549] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:51 2022] DELETE /identity/v3/users/36ec14ae328646a399afa1c0fd2d3d0d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:07:52.007288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:52.008734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:52.021045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1286/2550] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:07:52.279994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:52.283421 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:52.358275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:52.375879 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d5fb9-4d91-44de-a258-0324d351774b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:52.380539 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:52.381198 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:52.381473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:52.381800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] PATH_INFO: `/v3/projects/e183b124fc424b97a9fea9754d57f80d` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:52.382935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e183b124fc424b97a9fea9754d57f80d)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:52.384823 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:52.432333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e183b124fc424b97a9fea9754d57f80d', 'request_id': 'req-1595f61a-bbae-45d5-83e0-35aec0880865'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.440257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e183b124fc424b97a9fea9754d57f80d', 'request_id': 'req-1595f61a-bbae-45d5-83e0-35aec0880865'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.447253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e183b124fc424b97a9fea9754d57f80d', 'request_id': 'req-1595f61a-bbae-45d5-83e0-35aec0880865'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.458476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] The token cache is being invalidate because project e183b124fc424b97a9fea9754d57f80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:52.458760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.459405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.460954 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1265/2551] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:52 2022] DELETE /identity/v3/projects/e183b124fc424b97a9fea9754d57f80d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:52.465057 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:52.475441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b6b2a-9d6e-43f1-8ee1-7c99f461a5e5 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:52.532394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:52.533081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:52.533392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:52.535026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] PATH_INFO: `/v3/users/9b1a787bd4ef44f1914e81ca31e55ea0` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:52.535026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b1a787bd4ef44f1914e81ca31e55ea0)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:52.536755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:52.583463 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b1a787bd4ef44f1914e81ca31e55ea0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.590599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b1a787bd4ef44f1914e81ca31e55ea0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.603639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b1a787bd4ef44f1914e81ca31e55ea0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.604322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b1a787bd4ef44f1914e81ca31e55ea0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.611338 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-dc4d9b5d-b686-44b5-94a6-f0121105d828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b1a787bd4ef44f1914e81ca31e55ea0'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:52.617033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1287/2552] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:52 2022] DELETE /identity/v3/users/9b1a787bd4ef44f1914e81ca31e55ea0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:52.895694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:52.897185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:52.910382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f61a-bbae-45d5-83e0-35aec0880865 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:52.967713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:52.968338 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:52.968617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:52.968899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] PATH_INFO: `/v3/projects/634076f82f8243b9b75dba6ccf7b1d94` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:52.970334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] RBAC: Authorizing `identity:delete_project(project_id=634076f82f8243b9b75dba6ccf7b1d94)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:52.972225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.017804 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634076f82f8243b9b75dba6ccf7b1d94', 'request_id': 'req-006897be-e6eb-4ae5-8965-f81276a5808f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:53.024696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634076f82f8243b9b75dba6ccf7b1d94', 'request_id': 'req-006897be-e6eb-4ae5-8965-f81276a5808f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:53.030625 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634076f82f8243b9b75dba6ccf7b1d94', 'request_id': 'req-006897be-e6eb-4ae5-8965-f81276a5808f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:53.041570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] The token cache is being invalidate because project 634076f82f8243b9b75dba6ccf7b1d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:53.041870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:53.042518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-006897be-e6eb-4ae5-8965-f81276a5808f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:53.043958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1266/2553] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:52 2022] DELETE /identity/v3/projects/634076f82f8243b9b75dba6ccf7b1d94 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:53.050705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580be63-2e63-4dfd-8700-71e4ae93a60e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.050990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580be63-2e63-4dfd-8700-71e4ae93a60e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.051263 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580be63-2e63-4dfd-8700-71e4ae93a60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.070632 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0580be63-2e63-4dfd-8700-71e4ae93a60e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:53.072075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0580be63-2e63-4dfd-8700-71e4ae93a60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:53.076124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:53.134228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1288/2554] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:53.142912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957edf6-0702-4951-b2bc-5e283c523af1 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.143173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957edf6-0702-4951-b2bc-5e283c523af1 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.143446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957edf6-0702-4951-b2bc-5e283c523af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.163692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-6957edf6-0702-4951-b2bc-5e283c523af1 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:53.164891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6957edf6-0702-4951-b2bc-5e283c523af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:53.174012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1267/2555] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:07:53.178747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580be63-2e63-4dfd-8700-71e4ae93a60e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.188478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580be63-2e63-4dfd-8700-71e4ae93a60e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.193015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.193599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.193871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.194166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.194803 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:07:53.195099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.197005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.208800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1289/2556] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:07:53.213133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957edf6-0702-4951-b2bc-5e283c523af1 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.217451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:53.224416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957edf6-0702-4951-b2bc-5e283c523af1 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.230020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.230631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.230902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.231167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.231791 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.233664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.261834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1268/2557] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:53 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:53.266080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.275855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab61417-7c41-432d-93de-492261a36252 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.331220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.331809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.332089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.332358 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.332965 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.334887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.356042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1290/2558] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:53 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:53.360280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.370342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2368ff8-72a2-482d-8414-06420e73cb1c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.375146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.375799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.376099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.376455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.377500 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.378911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.389080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1269/2559] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:53.393248 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.403453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111478-1caa-4519-b8e9-c0e57a6a6fda admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.408940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25a84b-1c1a-4265-a2b9-424e2b91d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.409608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25a84b-1c1a-4265-a2b9-424e2b91d014 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.409924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25a84b-1c1a-4265-a2b9-424e2b91d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.410211 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25a84b-1c1a-4265-a2b9-424e2b91d014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.410871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25a84b-1c1a-4265-a2b9-424e2b91d014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.412455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25a84b-1c1a-4265-a2b9-424e2b91d014 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.423985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1291/2560] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:53.428147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.438003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706228e3-7c31-451d-bb90-679fedd9d532 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.442679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.443325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.443604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.443873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] PATH_INFO: `/v3/projects/0618150a31594b71a51fc3a627ca56ab/users/fde4e9b837d04786b232ee227e12e8f2/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.459056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0618150a31594b71a51fc3a627ca56ab, user_id=fde4e9b837d04786b232ee227e12e8f2, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.461536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.476062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1270/2561] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:53 2022] PUT /identity/v3/projects/0618150a31594b71a51fc3a627ca56ab/users/fde4e9b837d04786b232ee227e12e8f2/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:53.488570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea488b8-02f7-4296-bdfd-0c2fd2c6ceea None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.489106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea488b8-02f7-4296-bdfd-0c2fd2c6ceea None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.489106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea488b8-02f7-4296-bdfd-0c2fd2c6ceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.518323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-0ea488b8-02f7-4296-bdfd-0c2fd2c6ceea None None] MFA Rules not processed for user `fde4e9b837d04786b232ee227e12e8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:53.519531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-0ea488b8-02f7-4296-bdfd-0c2fd2c6ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:53.588850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1292/2562] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:53.593368 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.655473 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80433b-a2e7-4924-b309-f80f2fbedd29 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.660966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.661566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.661844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.662139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.662793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.664716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.691148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1271/2563] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:53 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:53.695237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea488b8-02f7-4296-bdfd-0c2fd2c6ceea None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.702407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:53.707363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea488b8-02f7-4296-bdfd-0c2fd2c6ceea None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.763427 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.764027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.764303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.764572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.765201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.767829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.788996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1293/2564] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:53 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:53.792956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.803141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374b6f-34e1-4d80-bc19-bce895205fb1 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.807753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.808322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.808604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.808875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.809513 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.811159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.822325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1272/2565] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:53.826163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.836509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed4fae-5e65-4394-9bd3-ad86ea14068f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.841073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.841708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.841989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.842293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] PATH_INFO: `/v3/projects/1bfc8ef85dd94902bbfccf655bd7e78d/users/5bfe0dd215f34ec2b5d877a1b099b2de/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.858133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfc8ef85dd94902bbfccf655bd7e78d, user_id=5bfe0dd215f34ec2b5d877a1b099b2de, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.860954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.873077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1294/2566] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:53 2022] PUT /identity/v3/projects/1bfc8ef85dd94902bbfccf655bd7e78d/users/5bfe0dd215f34ec2b5d877a1b099b2de/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:53.877875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.892815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be720924-c372-4904-91e0-a095b3d3c25f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.950043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d5db7-3453-4493-8409-1663930b4fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.950624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5db7-3453-4493-8409-1663930b4fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.950904 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5db7-3453-4493-8409-1663930b4fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.951178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5db7-3453-4493-8409-1663930b4fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.951815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d5db7-3453-4493-8409-1663930b4fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.953685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d5db7-3453-4493-8409-1663930b4fe7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.963696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1273/2567] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:53.967817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:53.978853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fc51e-a2c1-443f-9f8b-5a4d49582274 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:53.983400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:53.984034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:53.984306 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:53.985570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] PATH_INFO: `/v3/projects/1bfc8ef85dd94902bbfccf655bd7e78d/users/5bfe0dd215f34ec2b5d877a1b099b2de/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:53.987500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bfc8ef85dd94902bbfccf655bd7e78d, user_id=5bfe0dd215f34ec2b5d877a1b099b2de, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:53.990117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:53.999914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1295/2568] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:53 2022] PUT /identity/v3/projects/1bfc8ef85dd94902bbfccf655bd7e78d/users/5bfe0dd215f34ec2b5d877a1b099b2de/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:54.010244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14226851-77e4-40ce-b0a4-e7def8c7014f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:54.010530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14226851-77e4-40ce-b0a4-e7def8c7014f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:54.010802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14226851-77e4-40ce-b0a4-e7def8c7014f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:54.038870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-14226851-77e4-40ce-b0a4-e7def8c7014f None None] MFA Rules not processed for user `5bfe0dd215f34ec2b5d877a1b099b2de`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:54.040056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-14226851-77e4-40ce-b0a4-e7def8c7014f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:54.043852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:54.110040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1274/2569] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:54.122241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:54.123947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:54.182518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5688dff-84d8-4d2e-a2ce-b805c9dac4b5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:54.186160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:54.186761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:54.187040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:54.187313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:54.202636 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:54.204752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:54.214485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1296/2570] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:54.285610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14226851-77e4-40ce-b0a4-e7def8c7014f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:54.295085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14226851-77e4-40ce-b0a4-e7def8c7014f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:54.298794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:54.299379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:54.299655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:54.299923 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:54.356543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:54.357949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:54.367189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1275/2571] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:54.637477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:54.701415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:54.703032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:54.708239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cce97-26ea-4c2a-a514-706989437fb5 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:54.712707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:54.713444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:54.713724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:54.713999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] PATH_INFO: `/v3/users/fde4e9b837d04786b232ee227e12e8f2` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:54.714555 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0437aa-2246-479d-97c2-2bb3b520e2a5 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:54.715320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde4e9b837d04786b232ee227e12e8f2)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:54.717244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:54.718002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:54.718619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:54.718925 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:54.719062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:54.719191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:54.721061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:54.767089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde4e9b837d04786b232ee227e12e8f2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:54.774652 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde4e9b837d04786b232ee227e12e8f2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:54.787226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde4e9b837d04786b232ee227e12e8f2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:54.787851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde4e9b837d04786b232ee227e12e8f2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:54.794207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:54.794758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-65462bd6-e16b-49f3-883e-44ce665b6319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde4e9b837d04786b232ee227e12e8f2'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:54.795644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:54.800470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1297/2572] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:54 2022] DELETE /identity/v3/users/fde4e9b837d04786b232ee227e12e8f2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:54.804820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:54.805127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:54.805394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:54.807401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1276/2573] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:54.825208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:54.826428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:54.889864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1298/2574] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:07:54.901241 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:54.902864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:54.934512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:54.971602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a41e1-a4b9-46c8-988a-c45bc96ab215 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:55.024772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:55.025434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:55.025716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:55.025987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:55.035972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:55.037665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:55.047596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1277/2575] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:55.311290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:55.313223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:55.325629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071a32f-d9a0-4fdb-a0c5-4c1c8a473baa None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:55.332689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:55.333708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:55.334163 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:55.334436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] PATH_INFO: `/v3/projects/0618150a31594b71a51fc3a627ca56ab` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:55.335582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0618150a31594b71a51fc3a627ca56ab)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:55.337508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:55.384498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0618150a31594b71a51fc3a627ca56ab', 'request_id': 'req-cc2c2e82-cb68-4dec-8766-7142df56a123'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.390196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0618150a31594b71a51fc3a627ca56ab', 'request_id': 'req-cc2c2e82-cb68-4dec-8766-7142df56a123'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.397027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0618150a31594b71a51fc3a627ca56ab', 'request_id': 'req-cc2c2e82-cb68-4dec-8766-7142df56a123'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.410849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] The token cache is being invalidate because project 0618150a31594b71a51fc3a627ca56ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:55.411138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.411784 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.413290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1299/2576] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:55 2022] DELETE /identity/v3/projects/0618150a31594b71a51fc3a627ca56ab => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:55.417354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:55.426984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9013a-1796-4e65-8be1-e9f86c19c16e service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:55.483399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:55.484022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:55.484301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:55.484593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] PATH_INFO: `/v3/users/5bfe0dd215f34ec2b5d877a1b099b2de` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:55.485707 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfe0dd215f34ec2b5d877a1b099b2de)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:55.487705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:55.532746 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfe0dd215f34ec2b5d877a1b099b2de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.539842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfe0dd215f34ec2b5d877a1b099b2de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.540553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfe0dd215f34ec2b5d877a1b099b2de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.547450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfe0dd215f34ec2b5d877a1b099b2de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.559098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-7095ca0d-36a7-4410-b0b4-0d37a3d4936e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfe0dd215f34ec2b5d877a1b099b2de'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.565361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1278/2577] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:55 2022] DELETE /identity/v3/users/5bfe0dd215f34ec2b5d877a1b099b2de => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:55.855114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:55.856541 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:55.867082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:55.876174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c2e82-cb68-4dec-8766-7142df56a123 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:55.941850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:55.942609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:55.942888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:55.943159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] PATH_INFO: `/v3/projects/1bfc8ef85dd94902bbfccf655bd7e78d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:55.944532 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bfc8ef85dd94902bbfccf655bd7e78d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:55.947076 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:55.994073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bfc8ef85dd94902bbfccf655bd7e78d', 'request_id': 'req-c68e9820-f3f8-4aba-a273-d8f0b94823c6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:55.999590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bfc8ef85dd94902bbfccf655bd7e78d', 'request_id': 'req-c68e9820-f3f8-4aba-a273-d8f0b94823c6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:56.006609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bfc8ef85dd94902bbfccf655bd7e78d', 'request_id': 'req-c68e9820-f3f8-4aba-a273-d8f0b94823c6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:56.020804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] The token cache is being invalidate because project 1bfc8ef85dd94902bbfccf655bd7e78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:07:56.021150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:56.021797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c68e9820-f3f8-4aba-a273-d8f0b94823c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:07:56.023821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1300/2578] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:07:55 2022] DELETE /identity/v3/projects/1bfc8ef85dd94902bbfccf655bd7e78d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:56.028488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db358-0652-4ea9-b10a-fadd3c27f4e5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.028772 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db358-0652-4ea9-b10a-fadd3c27f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.029637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1db358-0652-4ea9-b10a-fadd3c27f4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.037548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:56.052325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-de1db358-0652-4ea9-b10a-fadd3c27f4e5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:56.055519 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-de1db358-0652-4ea9-b10a-fadd3c27f4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:56.115459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1279/2579] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:56.123235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280949d8-64ad-4555-82e1-de2757ef5e31 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.123487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280949d8-64ad-4555-82e1-de2757ef5e31 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.123761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280949d8-64ad-4555-82e1-de2757ef5e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.144142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-280949d8-64ad-4555-82e1-de2757ef5e31 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:56.145350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-280949d8-64ad-4555-82e1-de2757ef5e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:56.155285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1301/2580] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:56.159803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1db358-0652-4ea9-b10a-fadd3c27f4e5 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.171194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1db358-0652-4ea9-b10a-fadd3c27f4e5 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.177395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.178008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.178327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.178608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.179255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:07:56.179557 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.181133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.194000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1280/2581] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:07:56.198776 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280949d8-64ad-4555-82e1-de2757ef5e31 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.209503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280949d8-64ad-4555-82e1-de2757ef5e31 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.214475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.215159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.216269 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.216575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.217225 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.219930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.254681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1302/2582] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:56 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:56.258878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.269176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f798c1-644b-4046-bb3b-87e0eba9e538 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.326735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.327483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.327766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.328118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.328717 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.330712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.353578 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1281/2583] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:56 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:07:56.357409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.368653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c4178-87c5-48cd-a3cc-a004892a32d4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.373644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.374272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.374553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.374821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.375596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.377184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.388319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1303/2584] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:56.391872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.402131 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6d23c-b296-4f52-b5d5-804dbfd03739 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.407377 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea472-66a5-4cb8-9b52-680292d78a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.408011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea472-66a5-4cb8-9b52-680292d78a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.408293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea472-66a5-4cb8-9b52-680292d78a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.408567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea472-66a5-4cb8-9b52-680292d78a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.409204 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeea472-66a5-4cb8-9b52-680292d78a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.410829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeea472-66a5-4cb8-9b52-680292d78a7d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.421547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1282/2585] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:07:56.426477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.436302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bb171-2ba2-42aa-9b83-8234d35ec9dd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.440951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.441583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.441864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.442169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] PATH_INFO: `/v3/projects/6d1baaf7368749e7a30464e92cadde90/users/223b5804d06f4be39845f324d67bee3f/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.458522 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1baaf7368749e7a30464e92cadde90, user_id=223b5804d06f4be39845f324d67bee3f, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.461182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.474793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1304/2586] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:56 2022] PUT /identity/v3/projects/6d1baaf7368749e7a30464e92cadde90/users/223b5804d06f4be39845f324d67bee3f/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:56.541924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347ea1-e618-4769-889e-6e2522d1af52 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.542191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347ea1-e618-4769-889e-6e2522d1af52 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.542523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347ea1-e618-4769-889e-6e2522d1af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.569793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ec347ea1-e618-4769-889e-6e2522d1af52 None None] MFA Rules not processed for user `223b5804d06f4be39845f324d67bee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:56.571117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ec347ea1-e618-4769-889e-6e2522d1af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:56.629827 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:56.635245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1283/2587] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:56.639612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.670742 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:56.705204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881a89-0348-4bd1-be84-4692e89a0eea admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.709880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.710509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.710787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.711059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.711689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.713580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.739937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1305/2588] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:07:56 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:56.744117 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347ea1-e618-4769-889e-6e2522d1af52 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.754544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347ea1-e618-4769-889e-6e2522d1af52 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.808651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.809174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.809450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.809715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.810357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.812252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.834309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1284/2589] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:07:56 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:07:56.838389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.849066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68ae6b-36c0-4946-bbdf-5b4884ca7d54 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.853967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.854622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.854902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.855175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.855813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.857410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.868648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1306/2590] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:56.872679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.882563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a8034-d9a8-44d3-abf7-4260a652627c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.887133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.887768 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.888043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.888313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] PATH_INFO: `/v3/projects/5298167e3f9d43779b64d1a5210ab270/users/b7c180cdc684491ea3eaafc160786f69/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.902616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5298167e3f9d43779b64d1a5210ab270, user_id=b7c180cdc684491ea3eaafc160786f69, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.905271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:56.920446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1285/2591] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:56 2022] PUT /identity/v3/projects/5298167e3f9d43779b64d1a5210ab270/users/b7c180cdc684491ea3eaafc160786f69/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:56.925190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:56.934982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420192-8b61-4060-99ac-7af67d9d6d01 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:56.992406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed0389-1d61-433e-b316-df6731ba4fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:56.993001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed0389-1d61-433e-b316-df6731ba4fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:56.993386 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed0389-1d61-433e-b316-df6731ba4fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:56.993657 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed0389-1d61-433e-b316-df6731ba4fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:56.994311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed0389-1d61-433e-b316-df6731ba4fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:56.996053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed0389-1d61-433e-b316-df6731ba4fd3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:57.006017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1307/2592] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:07:57.010336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:57.020778 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93e46b-fd1b-4753-b353-5f9f6ad58fcf admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:57.025496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:57.026165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:57.026442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:57.026715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] PATH_INFO: `/v3/projects/5298167e3f9d43779b64d1a5210ab270/users/b7c180cdc684491ea3eaafc160786f69/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:57.028608 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5298167e3f9d43779b64d1a5210ab270, user_id=b7c180cdc684491ea3eaafc160786f69, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:57.031800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:57.041974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1286/2593] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:07:57 2022] PUT /identity/v3/projects/5298167e3f9d43779b64d1a5210ab270/users/b7c180cdc684491ea3eaafc160786f69/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:07:57.052892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb8cf5-087c-4819-b260-5b84425f7dcf None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:57.053222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb8cf5-087c-4819-b260-5b84425f7dcf None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:57.053498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb8cf5-087c-4819-b260-5b84425f7dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:57.081733 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d0eb8cf5-087c-4819-b260-5b84425f7dcf None None] MFA Rules not processed for user `b7c180cdc684491ea3eaafc160786f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:07:57.082940 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d0eb8cf5-087c-4819-b260-5b84425f7dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:57.149098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1308/2594] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:07:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:07:57.160502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:57.162233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:07:57.219306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7230d3b-71d6-490a-bdbd-59736ede320e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:57.222909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4efcf-88ac-4258-ba2c-b0f8449f47c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:57.223505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4efcf-88ac-4258-ba2c-b0f8449f47c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:57.223781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4efcf-88ac-4258-ba2c-b0f8449f47c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:57.224052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4efcf-88ac-4258-ba2c-b0f8449f47c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:57.278740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4efcf-88ac-4258-ba2c-b0f8449f47c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:57.280164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4efcf-88ac-4258-ba2c-b0f8449f47c3 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:07:57.289680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1287/2595] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:07:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:07:59.839038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb8cf5-087c-4819-b260-5b84425f7dcf None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:07:59.871006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:07:59.932365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb8cf5-087c-4819-b260-5b84425f7dcf None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:07:59.937479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:07:59.938195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:07:59.938622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:07:59.939489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] PATH_INFO: `/v3/users/223b5804d06f4be39845f324d67bee3f` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:07:59.940720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223b5804d06f4be39845f324d67bee3f)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:07:59.942666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:00.011411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223b5804d06f4be39845f324d67bee3f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.029802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223b5804d06f4be39845f324d67bee3f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.045674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223b5804d06f4be39845f324d67bee3f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.046647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223b5804d06f4be39845f324d67bee3f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.056129 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223b5804d06f4be39845f324d67bee3f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.063506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1309/2596] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:07:59 2022] DELETE /identity/v3/users/223b5804d06f4be39845f324d67bee3f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:00.067890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:00.068385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:00.068494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:00.077148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:00.090765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:00.092126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:00.152624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1288/2597] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:00.162547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:00.163955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:00.226198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e725-e04b-4457-94bd-395e416dd363 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:00.229817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:00.230465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:00.230745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:00.231015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:00.241208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:00.242696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:00.253485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1310/2598] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:00.533969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:00.535424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:00.548213 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e2fa1-e96b-41da-bac9-40cf31195915 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:00.552972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:00.553680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:00.554026 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:00.554488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] PATH_INFO: `/v3/projects/6d1baaf7368749e7a30464e92cadde90` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:00.555612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1baaf7368749e7a30464e92cadde90)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:00.557544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:00.604246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1baaf7368749e7a30464e92cadde90', 'request_id': 'req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.612167 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1baaf7368749e7a30464e92cadde90', 'request_id': 'req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.618433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1baaf7368749e7a30464e92cadde90', 'request_id': 'req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.628753 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] The token cache is being invalidate because project 6d1baaf7368749e7a30464e92cadde90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:00.629039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.629677 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.631182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1289/2599] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:00 2022] DELETE /identity/v3/projects/6d1baaf7368749e7a30464e92cadde90 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:00.635126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:00.644704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee70d0b-784c-4e6f-b21a-654d7df81d61 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:00.688851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:00.704326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:00.704990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:00.705268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:00.705538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] PATH_INFO: `/v3/users/b7c180cdc684491ea3eaafc160786f69` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:00.706930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c180cdc684491ea3eaafc160786f69)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:00.709670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:00.756938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c180cdc684491ea3eaafc160786f69'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.764645 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c180cdc684491ea3eaafc160786f69'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.777133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c180cdc684491ea3eaafc160786f69'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.777773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c180cdc684491ea3eaafc160786f69'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.785125 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5a8f77b0-767d-4d98-864c-2b45c54d9ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c180cdc684491ea3eaafc160786f69'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:00.790884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1311/2600] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:00 2022] DELETE /identity/v3/users/b7c180cdc684491ea3eaafc160786f69 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:01.063501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.065320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:01.085152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce19bcb-8bf2-447b-814a-11b5e62c0d6b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.152141 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.152788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.153070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.153340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] PATH_INFO: `/v3/projects/5298167e3f9d43779b64d1a5210ab270` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.154494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5298167e3f9d43779b64d1a5210ab270)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.157083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.193458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:01.209526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5298167e3f9d43779b64d1a5210ab270', 'request_id': 'req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:01.216875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5298167e3f9d43779b64d1a5210ab270', 'request_id': 'req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:01.224372 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5298167e3f9d43779b64d1a5210ab270', 'request_id': 'req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:01.237979 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] The token cache is being invalidate because project 5298167e3f9d43779b64d1a5210ab270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:01.238306 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:01.238963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-bbe7cc26-0151-45cf-958d-5b1bdf8c9efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:01.240475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1290/2601] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:01 2022] DELETE /identity/v3/projects/5298167e3f9d43779b64d1a5210ab270 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:01.245735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3ea2-d4f4-430c-bfe0-b57624c36323 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.246229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3ea2-d4f4-430c-bfe0-b57624c36323 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.246466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3ea2-d4f4-430c-bfe0-b57624c36323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.267314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fbfb3ea2-d4f4-430c-bfe0-b57624c36323 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:01.268548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fbfb3ea2-d4f4-430c-bfe0-b57624c36323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:01.335292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1312/2602] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:01.342868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a794e-dfed-4846-9ffb-310c6dfc7e35 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.343152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a794e-dfed-4846-9ffb-310c6dfc7e35 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.343468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a794e-dfed-4846-9ffb-310c6dfc7e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.363321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-5a1a794e-dfed-4846-9ffb-310c6dfc7e35 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:01.364542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5a1a794e-dfed-4846-9ffb-310c6dfc7e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:01.372486 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1291/2603] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:01.377277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb3ea2-d4f4-430c-bfe0-b57624c36323 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.386748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb3ea2-d4f4-430c-bfe0-b57624c36323 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.391900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.392494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.392766 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.393035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.393677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:01.393969 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.395579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.407675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1313/2604] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:08:01.411953 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a794e-dfed-4846-9ffb-310c6dfc7e35 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.421102 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a794e-dfed-4846-9ffb-310c6dfc7e35 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.425741 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.426365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.426636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.426906 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.427535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.429411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.462426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1292/2605] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:01 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:01.464521 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.475259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbc5f6-036c-4dbd-90dd-99bd5bc93096 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.523069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:01.534270 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.534891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.535177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.535450 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.536087 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.538009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.562775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1314/2606] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:01 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:01.564669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.577088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fa4e5-6a9e-4a2e-bfb7-bc5c33a0dffe admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.584285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.585070 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.585441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.586018 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.586829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.588502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.599998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1293/2607] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:01.604045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.615136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e3119-1e83-4a20-815d-669ffc2567a2 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.619869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a210e16-4634-47a8-a1d1-7ded420675d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.620612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a210e16-4634-47a8-a1d1-7ded420675d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.620897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a210e16-4634-47a8-a1d1-7ded420675d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.621171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a210e16-4634-47a8-a1d1-7ded420675d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.621814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a210e16-4634-47a8-a1d1-7ded420675d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.623451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a210e16-4634-47a8-a1d1-7ded420675d3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.635650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1315/2608] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:01.640045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.650619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d6c3c-03a6-4969-b39f-924052e597cd admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.655290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.655963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.656243 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.656524 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] PATH_INFO: `/v3/projects/992e84b454494dda9db7af7cca8e4724/users/80bc41d8421f4b55b7b3f3e572f2d95e/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.675673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=992e84b454494dda9db7af7cca8e4724, user_id=80bc41d8421f4b55b7b3f3e572f2d95e, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.678617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.694703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1294/2609] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:01 2022] PUT /identity/v3/projects/992e84b454494dda9db7af7cca8e4724/users/80bc41d8421f4b55b7b3f3e572f2d95e/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:01.706548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c4ea-8e43-4848-9b1d-172c673f8dac None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.706907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c4ea-8e43-4848-9b1d-172c673f8dac None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.707246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c4ea-8e43-4848-9b1d-172c673f8dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.744255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a652c4ea-8e43-4848-9b1d-172c673f8dac None None] MFA Rules not processed for user `80bc41d8421f4b55b7b3f3e572f2d95e`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:01.745517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a652c4ea-8e43-4848-9b1d-172c673f8dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:01.816192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1316/2610] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:01.820764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.887180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e114dd3-05e3-47d7-a409-015c3db4c65d admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:01.891961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:01.892564 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:01.892842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:01.893114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:01.893738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:01.895667 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:01.923179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1295/2611] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:01.928126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c4ea-8e43-4848-9b1d-172c673f8dac None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:01.940966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c4ea-8e43-4848-9b1d-172c673f8dac None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.001010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.001621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.001902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.002207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.002831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.004750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.025533 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1317/2612] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:01 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:02.029529 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.040479 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c98a-9efe-44a7-8486-7f33e791e0b8 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.045168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.045759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.046033 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.046336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.047601 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.049170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.059748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1296/2613] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:02.064325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.075490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc39aa6-f33d-4b47-bb76-e8dac557178f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.080418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1c02f-e1c7-494d-9bed-6d428369801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.081009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c02f-e1c7-494d-9bed-6d428369801c admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.081288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c02f-e1c7-494d-9bed-6d428369801c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.081559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c02f-e1c7-494d-9bed-6d428369801c admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.082233 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1c02f-e1c7-494d-9bed-6d428369801c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.083828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1c02f-e1c7-494d-9bed-6d428369801c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.094200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1318/2614] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:02.098512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.109922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0012-f493-495e-8808-d1a8502b5bdf admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.114515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.115154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.115428 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.115699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] PATH_INFO: `/v3/projects/660ed58cac254ea6bc4606935f73f426/users/cc0e19f6656d470999ae77524d191e03/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.129883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=660ed58cac254ea6bc4606935f73f426, user_id=cc0e19f6656d470999ae77524d191e03, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.132530 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.145151 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1297/2615] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:02 2022] PUT /identity/v3/projects/660ed58cac254ea6bc4606935f73f426/users/cc0e19f6656d470999ae77524d191e03/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:02.155357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922453-e1c1-4d35-a111-94eaf0003239 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.155647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922453-e1c1-4d35-a111-94eaf0003239 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.156564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd922453-e1c1-4d35-a111-94eaf0003239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.188466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-dd922453-e1c1-4d35-a111-94eaf0003239 None None] MFA Rules not processed for user `cc0e19f6656d470999ae77524d191e03`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:02.189660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-dd922453-e1c1-4d35-a111-94eaf0003239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:02.218967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:02.255818 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1319/2616] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:02.260285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.266066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:02.323498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bda22-3647-45c2-b433-56ada1027d6e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.328342 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.328977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.329250 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.329517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.330158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.332024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.359929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1298/2617] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:02 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:02.364138 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922453-e1c1-4d35-a111-94eaf0003239 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.374867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd922453-e1c1-4d35-a111-94eaf0003239 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.430677 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.431196 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.431475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.431746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.432375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.434310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.455830 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1320/2618] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:02 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:02.459974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.471357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f8d60-bad6-4293-8909-686ab804053b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.475917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.476494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.476767 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.477061 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.477685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.479280 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.489939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1299/2619] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:02.493888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.503876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4ed34-f5bc-4368-88d8-d0ab01110e00 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.508446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.509137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.509423 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.509696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] PATH_INFO: `/v3/projects/e46690ecb8304457bdb7e9e23bfe350b/users/e65246a6621d40359d2e6ae5168e377e/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.525014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46690ecb8304457bdb7e9e23bfe350b, user_id=e65246a6621d40359d2e6ae5168e377e, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.527678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.540945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1321/2620] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:02 2022] PUT /identity/v3/projects/e46690ecb8304457bdb7e9e23bfe350b/users/e65246a6621d40359d2e6ae5168e377e/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:02.545144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.555374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a73d6-4130-4174-bb5a-7b965c20dfc7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.612390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54d9e-2557-49aa-a535-94df6e54fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.612975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54d9e-2557-49aa-a535-94df6e54fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.613249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54d9e-2557-49aa-a535-94df6e54fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.613514 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54d9e-2557-49aa-a535-94df6e54fc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.614158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54d9e-2557-49aa-a535-94df6e54fc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.615731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54d9e-2557-49aa-a535-94df6e54fc26 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.625597 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1300/2621] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:02.629641 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.639979 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114694e4-05af-4576-b218-873e23fff82f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.645134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.645767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.646041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.646371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] PATH_INFO: `/v3/projects/e46690ecb8304457bdb7e9e23bfe350b/users/e65246a6621d40359d2e6ae5168e377e/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.648244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46690ecb8304457bdb7e9e23bfe350b, user_id=e65246a6621d40359d2e6ae5168e377e, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.650881 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.661583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1322/2622] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:02 2022] PUT /identity/v3/projects/e46690ecb8304457bdb7e9e23bfe350b/users/e65246a6621d40359d2e6ae5168e377e/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:02.672978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.673268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.673547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.701610 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] MFA Rules not processed for user `e65246a6621d40359d2e6ae5168e377e`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:02.703357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:02.767925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:02.771798 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1301/2623] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:02.784044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:02.785734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:02.842220 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310317d-2126-4148-807b-fa03a9a226fa admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:02.846451 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:02.847048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:02.847348 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:02.847613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:02.884223 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:02.909311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:02.910761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:02.925162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1323/2624] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:04.450145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:04.451531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:04.464645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90378511-aeb3-43e7-b150-08b44f049cef None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:04.468257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:04.468845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:04.469122 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:04.469382 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:04.524726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:04.526273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:04.535265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1302/2625] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:05.064763 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:05.074011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf73da-f9b5-4f9c-8d63-53b706646688 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:05.077613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:05.078496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:05.078779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:05.079047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:05.088083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:05.089503 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:05.099400 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1324/2626] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:05.452155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:05.454105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:05.509885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafdfbd-5b39-4b42-9871-043e95f21500 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:05.513449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:05.514042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:05.514346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:05.514618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:05.516842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:05.579664 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:05.581073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:05.590452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1303/2627] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:08.813059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:08.814579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:08.828923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae10cb1-0c9d-416a-bbba-5db1f32451b3 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:08.833578 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:08.834442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:08.834728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:08.835003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] PATH_INFO: `/v3/users/2b2e394413974cd282048e582447aeb7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:08.849728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2e394413974cd282048e582447aeb7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:08.851695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:08.898251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2e394413974cd282048e582447aeb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:08.906741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2e394413974cd282048e582447aeb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:08.920369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2e394413974cd282048e582447aeb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:08.921045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2e394413974cd282048e582447aeb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:08.928589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2e394413974cd282048e582447aeb7'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:08.934434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1325/2628] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:08 2022] DELETE /identity/v3/users/2b2e394413974cd282048e582447aeb7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:09.036353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.046409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa6640-a72d-4790-8701-7650701531d9 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.094163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:09.107279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.107946 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.108178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.108459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] PATH_INFO: `/v3/users/80bc41d8421f4b55b7b3f3e572f2d95e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.109878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80bc41d8421f4b55b7b3f3e572f2d95e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.111934 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.118179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.119738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.135108 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89da1-d814-4d05-802a-a292c0a3729b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.142001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.143005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.143278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.143545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] PATH_INFO: `/v3/projects/1ac504b0864c408fb4c635b3dd5aed83` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.155397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac504b0864c408fb4c635b3dd5aed83)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.157627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.173297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80bc41d8421f4b55b7b3f3e572f2d95e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.181346 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80bc41d8421f4b55b7b3f3e572f2d95e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.182247 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80bc41d8421f4b55b7b3f3e572f2d95e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.190328 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80bc41d8421f4b55b7b3f3e572f2d95e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.203405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-5a60f1c7-3779-474d-b52a-0458b1bcf0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80bc41d8421f4b55b7b3f3e572f2d95e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.207972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac504b0864c408fb4c635b3dd5aed83', 'request_id': 'req-92085ee5-a989-4653-8aae-fd831195f895'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.209496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1304/2629] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:09 2022] DELETE /identity/v3/users/80bc41d8421f4b55b7b3f3e572f2d95e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:09.213543 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac504b0864c408fb4c635b3dd5aed83', 'request_id': 'req-92085ee5-a989-4653-8aae-fd831195f895'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.213865 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.214175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.214452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.220244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac504b0864c408fb4c635b3dd5aed83', 'request_id': 'req-92085ee5-a989-4653-8aae-fd831195f895'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.229700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:09.233721 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:09.235593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.236444 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] The token cache is being invalidate because project 1ac504b0864c408fb4c635b3dd5aed83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:09.237013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.238361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-92085ee5-a989-4653-8aae-fd831195f895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.240288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1326/2630] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:09 2022] DELETE /identity/v3/projects/1ac504b0864c408fb4c635b3dd5aed83 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:09.244995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44f88-7365-43b4-9a09-93c4cbf7c5c0 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.245281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44f88-7365-43b4-9a09-93c4cbf7c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.245565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b44f88-7365-43b4-9a09-93c4cbf7c5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.265831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-54b44f88-7365-43b4-9a09-93c4cbf7c5c0 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:09.267080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-54b44f88-7365-43b4-9a09-93c4cbf7c5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.297451 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1305/2631] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:09.306696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.308096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.328371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1327/2632] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:09.335691 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4f55-eb0b-4ab3-940d-8c88ad087978 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.335975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4f55-eb0b-4ab3-940d-8c88ad087978 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.336260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4f55-eb0b-4ab3-940d-8c88ad087978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.355736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-692c4f55-eb0b-4ab3-940d-8c88ad087978 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:09.356920 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-692c4f55-eb0b-4ab3-940d-8c88ad087978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.365412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1328/2633] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:09.367195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a8ae0-6af4-49cd-82bb-ee94fb2d02c6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.369439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4f55-eb0b-4ab3-940d-8c88ad087978 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.371016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.371618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.371894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.372163 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.379365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4f55-eb0b-4ab3-940d-8c88ad087978 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.382054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.383501 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.383880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.384453 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.384728 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.384995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.385655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:09.385946 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.387547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.393063 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1306/2634] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:09.400488 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1329/2635] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:08:09.404661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.414159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e57418-5861-48d3-9d7f-81b0b9da71a5 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.424996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.425602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.425890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.426193 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.426834 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.428856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.439303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:09.461733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1307/2636] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:09.466433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.477821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517c8b6-425e-4801-90e7-9a8c3cdebafd admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.540929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.541555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.546356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.546773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.548981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.551826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.579730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1330/2637] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:09.583616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.594396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a51bb8-5c8c-4de0-983b-39fc0cfa37d0 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.599255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.600101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.600472 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.600836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.601566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.603264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.615544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1308/2638] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:09.619468 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.630461 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180047c-628b-44fe-b313-4bc270e480cc admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.635268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.635873 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.636576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.636576 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.637053 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.638700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.649622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1331/2639] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:09.653777 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.664641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda474-7e2d-4b8c-acec-b5e61649c8e2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.669293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662116-48fa-483f-bb3e-817861d2523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.669936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662116-48fa-483f-bb3e-817861d2523d admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.670253 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662116-48fa-483f-bb3e-817861d2523d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.670528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662116-48fa-483f-bb3e-817861d2523d admin admin] PATH_INFO: `/v3/projects/fd49ebd49d3b4462823140f82323bcb7/users/b7ed0dc3c1294e2fa6b01000243d7203/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.689761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00662116-48fa-483f-bb3e-817861d2523d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd49ebd49d3b4462823140f82323bcb7, user_id=b7ed0dc3c1294e2fa6b01000243d7203, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.693742 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00662116-48fa-483f-bb3e-817861d2523d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.700424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.705572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.714118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1309/2640] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:09 2022] PUT /identity/v3/projects/fd49ebd49d3b4462823140f82323bcb7/users/b7ed0dc3c1294e2fa6b01000243d7203/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:09.721341 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629cf1-9a03-4618-9005-b98e62995cb8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.721507 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b1bb-f8af-435a-9a87-088ddb39df66 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.721933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b1bb-f8af-435a-9a87-088ddb39df66 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.723032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02b1bb-f8af-435a-9a87-088ddb39df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.753096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7c02b1bb-f8af-435a-9a87-088ddb39df66 None None] MFA Rules not processed for user `b7ed0dc3c1294e2fa6b01000243d7203`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:09.754474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7c02b1bb-f8af-435a-9a87-088ddb39df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.775179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:09.782264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.783166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.783747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.784319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] PATH_INFO: `/v3/projects/992e84b454494dda9db7af7cca8e4724` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.785544 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=992e84b454494dda9db7af7cca8e4724)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.787608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.820299 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1310/2641] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:09.824896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b1bb-f8af-435a-9a87-088ddb39df66 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.834471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992e84b454494dda9db7af7cca8e4724', 'request_id': 'req-121d977d-b624-4124-96bd-e3b4d102f53d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.834996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02b1bb-f8af-435a-9a87-088ddb39df66 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.840194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992e84b454494dda9db7af7cca8e4724', 'request_id': 'req-121d977d-b624-4124-96bd-e3b4d102f53d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.847106 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992e84b454494dda9db7af7cca8e4724', 'request_id': 'req-121d977d-b624-4124-96bd-e3b4d102f53d'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.861990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] The token cache is being invalidate because project 992e84b454494dda9db7af7cca8e4724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:09.862320 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.862961 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:09.864624 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1332/2642] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:09 2022] DELETE /identity/v3/projects/992e84b454494dda9db7af7cca8e4724 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:09.868537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.869851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.895014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.895619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.895901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.896175 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.896797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:09.898738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:09.928201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1311/2643] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:09.929462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:09.931128 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:09.936193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d977d-b624-4124-96bd-e3b4d102f53d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.963140 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:09.997010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:09.997256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d13456-949c-48e5-8954-7114d3e1fb94 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:09.997554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:09.997831 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:09.998130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] PATH_INFO: `/v3/users/cc0e19f6656d470999ae77524d191e03` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:09.999272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0e19f6656d470999ae77524d191e03)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.001279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.002179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.002795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.003076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.003364 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.003982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.005931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.028893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1312/2644] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:09 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:10.033425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.043820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f64f1e-e798-43ee-9cd7-1f1e5feac2de admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.044438 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:10.049120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.049738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.049984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.050320 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.050910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.052483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.054134 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0e19f6656d470999ae77524d191e03'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.062629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0e19f6656d470999ae77524d191e03'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.064939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1313/2645] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:10.069062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.076460 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0e19f6656d470999ae77524d191e03'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.077139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0e19f6656d470999ae77524d191e03'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.079520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3216a-0f14-4886-89b1-9b0dd4deaeef admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.084169 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.084689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0e19f6656d470999ae77524d191e03'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.084802 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.085049 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.085316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] PATH_INFO: `/v3/projects/40547ff808d8406e9bbb90dd5f8111da/users/de603b6d566d48b48145c412665c28f3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.090627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1333/2646] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:09 2022] DELETE /identity/v3/users/cc0e19f6656d470999ae77524d191e03 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:10.100957 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40547ff808d8406e9bbb90dd5f8111da, user_id=de603b6d566d48b48145c412665c28f3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.104024 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.117147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1314/2647] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:10 2022] PUT /identity/v3/projects/40547ff808d8406e9bbb90dd5f8111da/users/de603b6d566d48b48145c412665c28f3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:10.121154 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.122755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.196048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d34ff-131b-4d43-9838-89e37a630270 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.260342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e59f3d-d8b5-4673-909a-16c4f6d5f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.261088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e59f3d-d8b5-4673-909a-16c4f6d5f965 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.261414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e59f3d-d8b5-4673-909a-16c4f6d5f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.261685 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e59f3d-d8b5-4673-909a-16c4f6d5f965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.262424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e59f3d-d8b5-4673-909a-16c4f6d5f965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.264041 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e59f3d-d8b5-4673-909a-16c4f6d5f965 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.275747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1334/2648] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:10.279896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.291290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26496c0-3894-4416-9dc5-352b6526037b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.296098 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.296893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.297334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.297612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] PATH_INFO: `/v3/projects/40547ff808d8406e9bbb90dd5f8111da/users/de603b6d566d48b48145c412665c28f3/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.299579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40547ff808d8406e9bbb90dd5f8111da, user_id=de603b6d566d48b48145c412665c28f3, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.302406 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.313439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1315/2649] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:10 2022] PUT /identity/v3/projects/40547ff808d8406e9bbb90dd5f8111da/users/de603b6d566d48b48145c412665c28f3/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:10.325185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.325556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.325828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.354390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] MFA Rules not processed for user `de603b6d566d48b48145c412665c28f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:10.355807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.384748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.388147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.408721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:10.440820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1335/2650] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:10.452235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.454471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.460239 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163617e-b2cb-45f3-927b-eeec78f77f67 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.465068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.465694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.465972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.466283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] PATH_INFO: `/v3/projects/660ed58cac254ea6bc4606935f73f426` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.467439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=660ed58cac254ea6bc4606935f73f426)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.469468 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.517227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b202-b576-4cbe-a6ef-ab4c8f72250a None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.522799 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660ed58cac254ea6bc4606935f73f426', 'request_id': 'req-f321fbf4-2b7a-4526-bed6-88005ebade62'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.530283 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660ed58cac254ea6bc4606935f73f426', 'request_id': 'req-f321fbf4-2b7a-4526-bed6-88005ebade62'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.536945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660ed58cac254ea6bc4606935f73f426', 'request_id': 'req-f321fbf4-2b7a-4526-bed6-88005ebade62'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.545021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:10.549029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] The token cache is being invalidate because project 660ed58cac254ea6bc4606935f73f426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:10.549322 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.550582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.552614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1316/2651] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:10 2022] DELETE /identity/v3/projects/660ed58cac254ea6bc4606935f73f426 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:10.556321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.557675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.569590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.570417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.570693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.570963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.573023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.624359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321fbf4-2b7a-4526-bed6-88005ebade62 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.629675 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.630333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.630642 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.630944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] PATH_INFO: `/v3/users/e65246a6621d40359d2e6ae5168e377e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.632079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65246a6621d40359d2e6ae5168e377e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.633981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.635411 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.636819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.647259 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1336/2652] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:10.689010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65246a6621d40359d2e6ae5168e377e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.705159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65246a6621d40359d2e6ae5168e377e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.705920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65246a6621d40359d2e6ae5168e377e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.715761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65246a6621d40359d2e6ae5168e377e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.730589 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:10.731158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65246a6621d40359d2e6ae5168e377e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:10.732412 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.738045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1317/2653] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:10 2022] DELETE /identity/v3/users/e65246a6621d40359d2e6ae5168e377e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:10.746277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df75bf-986b-418c-8939-b1057e83b7eb service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:10.791866 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:10.798499 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a2b8b-73ab-4005-b2d2-d714bf8eabdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:10.799150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a2b8b-73ab-4005-b2d2-d714bf8eabdd service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:10.799432 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a2b8b-73ab-4005-b2d2-d714bf8eabdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:10.799708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a2b8b-73ab-4005-b2d2-d714bf8eabdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:10.801825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-546a2b8b-73ab-4005-b2d2-d714bf8eabdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:10.868829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a2b8b-73ab-4005-b2d2-d714bf8eabdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:10.870388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a2b8b-73ab-4005-b2d2-d714bf8eabdd service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:10.880328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1337/2654] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:11.032341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.033781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:11.107023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e08f65-2ba2-437c-a8da-344175f5f8ea admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.111891 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.112510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.112783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.113046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] PATH_INFO: `/v3/projects/e46690ecb8304457bdb7e9e23bfe350b` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.114161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46690ecb8304457bdb7e9e23bfe350b)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.116039 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.138582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:11.164111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46690ecb8304457bdb7e9e23bfe350b', 'request_id': 'req-1c97b26e-2229-4f59-9f49-ddf41a7f212f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:11.171433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46690ecb8304457bdb7e9e23bfe350b', 'request_id': 'req-1c97b26e-2229-4f59-9f49-ddf41a7f212f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:11.178371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46690ecb8304457bdb7e9e23bfe350b', 'request_id': 'req-1c97b26e-2229-4f59-9f49-ddf41a7f212f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:11.189295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] The token cache is being invalidate because project e46690ecb8304457bdb7e9e23bfe350b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:11.189579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:11.190340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1c97b26e-2229-4f59-9f49-ddf41a7f212f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:11.191810 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1318/2655] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:11 2022] DELETE /identity/v3/projects/e46690ecb8304457bdb7e9e23bfe350b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:11.197081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d98a-00a8-4018-89c9-2fcbd97d59b7 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.197363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d98a-00a8-4018-89c9-2fcbd97d59b7 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.197637 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953d98a-00a8-4018-89c9-2fcbd97d59b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.218956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-7953d98a-00a8-4018-89c9-2fcbd97d59b7 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:11.220176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7953d98a-00a8-4018-89c9-2fcbd97d59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:11.278402 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1338/2656] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:11.286551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7608d5-d778-4833-8353-799a4fffc093 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.286775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7608d5-d778-4833-8353-799a4fffc093 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.287051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7608d5-d778-4833-8353-799a4fffc093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.306699 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ee7608d5-d778-4833-8353-799a4fffc093 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:11.307909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ee7608d5-d778-4833-8353-799a4fffc093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:11.316319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1319/2657] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:11.320475 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d98a-00a8-4018-89c9-2fcbd97d59b7 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.331389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953d98a-00a8-4018-89c9-2fcbd97d59b7 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.336023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.336617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.336897 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.337172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.337811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:11.338150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.339748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.351137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1339/2658] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:08:11.355329 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7608d5-d778-4833-8353-799a4fffc093 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.364690 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7608d5-d778-4833-8353-799a4fffc093 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.369359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.369947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.370268 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.370541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.371165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.373037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.400773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1320/2659] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:11 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:11.404851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.415195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a4e9-0a0b-4ad4-8078-969c0fd47e9b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.473890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.474584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.474860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.475126 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.475752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.477698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.498050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1340/2660] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:11 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:11.502759 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.513010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007fdf4-a082-48be-a373-421f00d15a7f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.517918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.518536 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.518818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.519090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.519722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.521296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.531064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1321/2661] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:11.534810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.544680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5dd12-40c2-4651-acca-4c709ccf8178 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.549735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ff3ea-5433-469b-b36b-7dbf7e8e68b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.550351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ff3ea-5433-469b-b36b-7dbf7e8e68b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.550629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ff3ea-5433-469b-b36b-7dbf7e8e68b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.550896 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ff3ea-5433-469b-b36b-7dbf7e8e68b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.551524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ff3ea-5433-469b-b36b-7dbf7e8e68b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.553091 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ff3ea-5433-469b-b36b-7dbf7e8e68b2 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.563988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1341/2662] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:11.567910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.577901 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a82cc-c91f-4eee-bf6c-ae1facdbcc52 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.582614 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.583248 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.583520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.583785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] PATH_INFO: `/v3/projects/0aa01ccd3d2545e8b168c10df7707b17/users/78b79aa0e5f54cf7bee4f2bd905acdbc/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.598391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa01ccd3d2545e8b168c10df7707b17, user_id=78b79aa0e5f54cf7bee4f2bd905acdbc, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.600987 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.614162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1322/2663] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:11 2022] PUT /identity/v3/projects/0aa01ccd3d2545e8b168c10df7707b17/users/78b79aa0e5f54cf7bee4f2bd905acdbc/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:11.624388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.624671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.624671 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.644615 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:11.653924 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] MFA Rules not processed for user `78b79aa0e5f54cf7bee4f2bd905acdbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:11.655147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:11.726879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1342/2664] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:11.739878 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:11.741579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:11.799344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e4e2b-da5e-4f94-bbeb-e5fa02026175 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:11.802928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3849cb5e321d48c88f0e19121ec7e1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:11.803521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:11.803801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:11.804075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:11.812202 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:11.813619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:11.822558 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1323/2665] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:21.723908 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=28 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:21.818321 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:23.319159 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:23.320548 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:23.376599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a305c2f-94a4-4d60-b309-4ec6c7657f31 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:23.380198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:23.380787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:23.381070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:23.381342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:23.383208 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:23.450119 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:23.451551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:23.461452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1343/2666] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:26.743855 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:26.745357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:26.760203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fbc37-4a23-4b92-b471-f76480770ceb service glance] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:26.764622 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:26.765246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:26.766238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:26.766694 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] PATH_INFO: `/v3/users/4bcd5d323ed6428d92b299218e900d2b` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:26.780775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bcd5d323ed6428d92b299218e900d2b)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:26.783196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:26.829149 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcd5d323ed6428d92b299218e900d2b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:26.836389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcd5d323ed6428d92b299218e900d2b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:26.836971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcd5d323ed6428d92b299218e900d2b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:26.843888 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcd5d323ed6428d92b299218e900d2b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:26.856244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f89b139-3771-4b1b-887d-dcccaf7206c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcd5d323ed6428d92b299218e900d2b'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:26.862678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1324/2667] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:26 2022] DELETE /identity/v3/users/4bcd5d323ed6428d92b299218e900d2b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:27.037479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.051447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0df1a1-5395-4a78-95c4-f8b505af81b8 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.113010 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.113633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.113906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.114207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] PATH_INFO: `/v3/projects/df4e72fc010440a8ad8af109d8285f34` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.124416 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4e72fc010440a8ad8af109d8285f34)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.126914 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.167808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:27.172403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4e72fc010440a8ad8af109d8285f34', 'request_id': 'req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:27.178572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4e72fc010440a8ad8af109d8285f34', 'request_id': 'req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:27.185088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4e72fc010440a8ad8af109d8285f34', 'request_id': 'req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:27.197599 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] The token cache is being invalidate because project df4e72fc010440a8ad8af109d8285f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:27.197883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:27.198523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-4eaf078e-ea4a-49e1-9798-7e5c47a220a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:27.199991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1344/2668] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:27 2022] DELETE /identity/v3/projects/df4e72fc010440a8ad8af109d8285f34 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:27.205127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a8462-d411-405d-b9a1-c768acc3ce99 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.205410 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a8462-d411-405d-b9a1-c768acc3ce99 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.205710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a8462-d411-405d-b9a1-c768acc3ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.225442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0d3a8462-d411-405d-b9a1-c768acc3ce99 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:27.226666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0d3a8462-d411-405d-b9a1-c768acc3ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:27.284314 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1325/2669] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:27.292513 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314103-1d1f-47fe-abc2-e6c948257960 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.292795 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314103-1d1f-47fe-abc2-e6c948257960 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.293067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314103-1d1f-47fe-abc2-e6c948257960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.317586 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-79314103-1d1f-47fe-abc2-e6c948257960 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:27.318393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-79314103-1d1f-47fe-abc2-e6c948257960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:27.326647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1345/2670] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:27.331021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a8462-d411-405d-b9a1-c768acc3ce99 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.340818 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a8462-d411-405d-b9a1-c768acc3ce99 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.351547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.351547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.351547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.351547 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.351947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:27.351947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.351947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.363640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1326/2671] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:08:27.368017 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79314103-1d1f-47fe-abc2-e6c948257960 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.377702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79314103-1d1f-47fe-abc2-e6c948257960 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.382507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.383174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.383564 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.383848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.384783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.387218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.425598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1346/2672] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:27 2022] POST /identity/v3/projects => generated 357 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:27.426847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.436978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c589f-765a-4c1f-8cc3-b23174936685 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.481600 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:27.496676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.497290 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.497602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.497874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.498545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.500670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.521458 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1327/2673] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:27 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:27.525633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.537553 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da6189-1672-45f4-84fd-5dd4a94e27d0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.542579 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.543190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.543469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.543740 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.544379 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.545970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.557064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1347/2674] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:27.561011 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.570924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f571ffc-e27a-438d-b15d-c546f0c436e5 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.576076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5740f-24e3-4b85-aeff-bc3aa3a0c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.576668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5740f-24e3-4b85-aeff-bc3aa3a0c4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.576942 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5740f-24e3-4b85-aeff-bc3aa3a0c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.577210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5740f-24e3-4b85-aeff-bc3aa3a0c4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.578152 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5740f-24e3-4b85-aeff-bc3aa3a0c4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.579710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5740f-24e3-4b85-aeff-bc3aa3a0c4b9 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.590502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1328/2675] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:27.595487 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.606127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e56274-8401-47c0-952d-b5153979c720 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.611026 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.611670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.611949 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.612221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] PATH_INFO: `/v3/projects/c634f5f6043e482089a1308113bf4945/users/8d7bcf2803464302979d4aac6d9cbe89/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.627062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c634f5f6043e482089a1308113bf4945, user_id=8d7bcf2803464302979d4aac6d9cbe89, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.629680 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.642813 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1348/2676] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:27 2022] PUT /identity/v3/projects/c634f5f6043e482089a1308113bf4945/users/8d7bcf2803464302979d4aac6d9cbe89/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:27.654135 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b539-54e6-4575-bcb9-349891515aa6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.654431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b539-54e6-4575-bcb9-349891515aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.654700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483b539-54e6-4575-bcb9-349891515aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.682806 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3483b539-54e6-4575-bcb9-349891515aa6 None None] MFA Rules not processed for user `8d7bcf2803464302979d4aac6d9cbe89`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:27.683938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3483b539-54e6-4575-bcb9-349891515aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:27.750824 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1329/2677] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:27.755300 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.816316 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fccd54-ded4-47d5-9b1a-4ec4b2b6eb59 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.821001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.821853 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.822150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.822418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.823061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.824985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.851849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1349/2678] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:27 2022] POST /identity/v3/projects => generated 357 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:27.855845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483b539-54e6-4575-bcb9-349891515aa6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.866927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483b539-54e6-4575-bcb9-349891515aa6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.922390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.922990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.923269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.923542 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.924189 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.926132 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.946927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1330/2679] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:27 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:27.950977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.962075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc163e-585a-417c-8c88-497a902b48e0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:27.966629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:27.967213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:27.967486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:27.967750 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:27.968977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:27.970584 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:27.980891 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1350/2680] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:27.985076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:27.995448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef14817-b7f9-45db-9f8e-3ed149a9af1e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:28.000766 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:28.001431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:28.001715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:28.002025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] PATH_INFO: `/v3/projects/8eb09c09108945edb369ce2587d9e2c4/users/384e7293948a4992a07c97ba0e1c6ffe/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:28.017094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb09c09108945edb369ce2587d9e2c4, user_id=384e7293948a4992a07c97ba0e1c6ffe, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:28.019870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:28.032743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1331/2681] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:27 2022] PUT /identity/v3/projects/8eb09c09108945edb369ce2587d9e2c4/users/384e7293948a4992a07c97ba0e1c6ffe/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:28.036785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:28.048454 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0c504-4f2e-4327-a060-077d44e9b38e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:28.090123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:28.110489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07a9e1-492f-44d3-9507-f668495ca3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:28.111224 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07a9e1-492f-44d3-9507-f668495ca3ec admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:28.111602 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07a9e1-492f-44d3-9507-f668495ca3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:28.111974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07a9e1-492f-44d3-9507-f668495ca3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:28.112749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07a9e1-492f-44d3-9507-f668495ca3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:28.114449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07a9e1-492f-44d3-9507-f668495ca3ec admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:28.128430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1351/2682] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:28.129516 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:28.139745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e26e6-76d8-4a1f-a1ed-11730717271d admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:28.144998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:28.145643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:28.145919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:28.146226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] PATH_INFO: `/v3/projects/8eb09c09108945edb369ce2587d9e2c4/users/384e7293948a4992a07c97ba0e1c6ffe/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:28.148119 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb09c09108945edb369ce2587d9e2c4, user_id=384e7293948a4992a07c97ba0e1c6ffe, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:28.150795 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:28.161133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1332/2683] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:28 2022] PUT /identity/v3/projects/8eb09c09108945edb369ce2587d9e2c4/users/384e7293948a4992a07c97ba0e1c6ffe/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:28.171296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35c6e-4369-40e9-8494-54e859f80b71 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:28.171743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35c6e-4369-40e9-8494-54e859f80b71 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:28.172107 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a35c6e-4369-40e9-8494-54e859f80b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:28.200679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-47a35c6e-4369-40e9-8494-54e859f80b71 None None] MFA Rules not processed for user `384e7293948a4992a07c97ba0e1c6ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:28.201785 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-47a35c6e-4369-40e9-8494-54e859f80b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:28.269394 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1352/2684] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:28.280563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:28.282401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:28.292905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:28.341619 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338d06-e6e3-4462-8d8e-e96c28dbd520 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:28.345391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:28.345990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:28.346316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:28.346589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:28.357144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:28.358611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:28.368469 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1333/2685] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:28.445771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a35c6e-4369-40e9-8494-54e859f80b71 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:28.458690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a35c6e-4369-40e9-8494-54e859f80b71 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:28.462698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:28.463294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:28.463570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:28.463841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:28.523075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:28.524676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:28.534282 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1353/2686] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:38.364317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=22 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:38.529792 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=72 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:43.296266 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:43.297846 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:43.365927 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bee9c-0e2f-4486-85b8-2a49429a2724 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:43.371307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:43.374503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:43.374771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:43.375046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] PATH_INFO: `/v3/users/78b79aa0e5f54cf7bee4f2bd905acdbc` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:43.376343 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b79aa0e5f54cf7bee4f2bd905acdbc)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:43.378727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:43.430651 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b79aa0e5f54cf7bee4f2bd905acdbc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.438233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b79aa0e5f54cf7bee4f2bd905acdbc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.440800 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b79aa0e5f54cf7bee4f2bd905acdbc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.450165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b79aa0e5f54cf7bee4f2bd905acdbc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.460301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:43.462907 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-20a6eb32-fea7-4557-83fc-9c99f93d058a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b79aa0e5f54cf7bee4f2bd905acdbc'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.469426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1334/2687] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:43 2022] DELETE /identity/v3/users/78b79aa0e5f54cf7bee4f2bd905acdbc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:43.471975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726882bf-f9cb-4d0c-99e2-958dc287f620 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:43.474379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:43.474850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:43.475118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:43.494195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:43.495395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:43.534246 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:43.534879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:43.535157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:43.535855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] PATH_INFO: `/v3/users/8d7bcf2803464302979d4aac6d9cbe89` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:43.536984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7bcf2803464302979d4aac6d9cbe89)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:43.539635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:43.558252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1335/2688] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:43.570025 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:43.571828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:43.596559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7bcf2803464302979d4aac6d9cbe89'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.603554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:43.609355 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7bcf2803464302979d4aac6d9cbe89'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.628557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7bcf2803464302979d4aac6d9cbe89'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.629550 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7bcf2803464302979d4aac6d9cbe89'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.638617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366baad3-5619-4937-8393-939f00e9411c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7bcf2803464302979d4aac6d9cbe89'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:43.643670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9cc1b-7fb8-4821-8227-90b38f14e247 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:43.645188 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1354/2689] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:43 2022] DELETE /identity/v3/users/8d7bcf2803464302979d4aac6d9cbe89 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:43.649928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:43.650283 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:43.650774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:43.670004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:43.671249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:43.719621 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7249d48-a3d4-4873-b42f-0695ae5afd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:43.720259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7249d48-a3d4-4873-b42f-0695ae5afd17 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:43.720609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7249d48-a3d4-4873-b42f-0695ae5afd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:43.721402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7249d48-a3d4-4873-b42f-0695ae5afd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:43.723680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f7249d48-a3d4-4873-b42f-0695ae5afd17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:43.749294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1355/2690] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:43.761047 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:43.763490 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:43.777799 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254902b-4979-4092-bfde-28dee5fd363e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:43.781440 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:43.782040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:43.782342 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:43.782610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:43.793588 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:43.795059 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:43.796012 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7249d48-a3d4-4873-b42f-0695ae5afd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:43.797466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7249d48-a3d4-4873-b42f-0695ae5afd17 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:43.805806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1356/2691] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:43.811993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1336/2692] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:43.934627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:43.936286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:43.950861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383aa7e-9035-4dcd-9a76-9803e32846cf service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:43.955600 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:43.956227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:43.956500 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:43.956768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] PATH_INFO: `/v3/users/b7ed0dc3c1294e2fa6b01000243d7203` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:43.957923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ed0dc3c1294e2fa6b01000243d7203)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:43.960025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:43.962068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:44.012483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ed0dc3c1294e2fa6b01000243d7203'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.020739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ed0dc3c1294e2fa6b01000243d7203'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.033658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ed0dc3c1294e2fa6b01000243d7203'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.034377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ed0dc3c1294e2fa6b01000243d7203'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.041410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ed0dc3c1294e2fa6b01000243d7203'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.047675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1357/2693] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:43 2022] DELETE /identity/v3/users/b7ed0dc3c1294e2fa6b01000243d7203 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:44.052089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:44.052369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:44.052640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:44.073947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:44.075391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.141255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1337/2694] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:44.156622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:44.159014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.225164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:44.227415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.227614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851aa16-bd38-43da-a0f3-f31d5233866d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:44.233745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:44.234434 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:44.234705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:44.235016 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:44.250369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641b3e2-a38e-4b1c-b50f-7b5cce14bed8 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:44.252257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:44.253816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:44.265617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1358/2695] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:44.266158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:44.266483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:44.266871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:44.267153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:44.267495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] PATH_INFO: `/v3/projects/0aa01ccd3d2545e8b168c10df7707b17` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:44.268478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.269511 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa01ccd3d2545e8b168c10df7707b17)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:44.271715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:44.282352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793b9d-8d98-473c-811b-32f22e50e565 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:44.288698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:44.289414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:44.289864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:44.290078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] PATH_INFO: `/v3/projects/c634f5f6043e482089a1308113bf4945` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:44.291735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c634f5f6043e482089a1308113bf4945)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:44.293913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:44.320255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:44.350685 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa01ccd3d2545e8b168c10df7707b17', 'request_id': 'req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.357610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c634f5f6043e482089a1308113bf4945', 'request_id': 'req-639ec2d7-0195-46cb-bf89-15c01250fc04'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.359462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa01ccd3d2545e8b168c10df7707b17', 'request_id': 'req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.365900 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c634f5f6043e482089a1308113bf4945', 'request_id': 'req-639ec2d7-0195-46cb-bf89-15c01250fc04'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.368845 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa01ccd3d2545e8b168c10df7707b17', 'request_id': 'req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.372477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c634f5f6043e482089a1308113bf4945', 'request_id': 'req-639ec2d7-0195-46cb-bf89-15c01250fc04'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.381365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] The token cache is being invalidate because project 0aa01ccd3d2545e8b168c10df7707b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:44.381779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.382545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.384341 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1338/2696] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:44 2022] DELETE /identity/v3/projects/0aa01ccd3d2545e8b168c10df7707b17 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:44.386947 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] The token cache is being invalidate because project c634f5f6043e482089a1308113bf4945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:44.387244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.387938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.389746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1359/2697] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:44 2022] DELETE /identity/v3/projects/c634f5f6043e482089a1308113bf4945 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:44.393815 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:44.395978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.489728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f184d6-ad9a-45c8-bb34-d69f2ae6770f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:44.565090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:44.566003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:44.566308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:44.566871 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] PATH_INFO: `/v3/users/384e7293948a4992a07c97ba0e1c6ffe` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:44.567796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] RBAC: Authorizing `identity:delete_user(user_id=384e7293948a4992a07c97ba0e1c6ffe)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:44.569733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:44.601802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:44.603810 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.633325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:44.637732 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384e7293948a4992a07c97ba0e1c6ffe'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.638028 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ec2d7-0195-46cb-bf89-15c01250fc04 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:44.649229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384e7293948a4992a07c97ba0e1c6ffe'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.649700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:44.650220 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384e7293948a4992a07c97ba0e1c6ffe'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.650814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:44.651370 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:44.651844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] PATH_INFO: `/v3/projects/fd49ebd49d3b4462823140f82323bcb7` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:44.653419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd49ebd49d3b4462823140f82323bcb7)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:44.655604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:44.656993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:44.660595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384e7293948a4992a07c97ba0e1c6ffe'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.677351 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384e7293948a4992a07c97ba0e1c6ffe'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.687882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1339/2698] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:44 2022] DELETE /identity/v3/users/384e7293948a4992a07c97ba0e1c6ffe => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:44.708275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd49ebd49d3b4462823140f82323bcb7', 'request_id': 'req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.713894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd49ebd49d3b4462823140f82323bcb7', 'request_id': 'req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.720175 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd49ebd49d3b4462823140f82323bcb7', 'request_id': 'req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.732082 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] The token cache is being invalidate because project fd49ebd49d3b4462823140f82323bcb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:44.732369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.732977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.734627 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1360/2699] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:44 2022] DELETE /identity/v3/projects/fd49ebd49d3b4462823140f82323bcb7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:44.739106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:44.740493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.808182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7e51c-09ca-4320-873c-6fefdaea45af admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:44.875534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:44.876168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:44.876447 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:44.876744 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] PATH_INFO: `/v3/users/de603b6d566d48b48145c412665c28f3` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:44.878035 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de603b6d566d48b48145c412665c28f3)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:44.880022 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:44.930257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de603b6d566d48b48145c412665c28f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.938144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de603b6d566d48b48145c412665c28f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.938919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de603b6d566d48b48145c412665c28f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.946727 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de603b6d566d48b48145c412665c28f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.960678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f1627c52-7525-47b7-a146-e7c71d704b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de603b6d566d48b48145c412665c28f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:44.967002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1340/2700] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:44 2022] DELETE /identity/v3/users/de603b6d566d48b48145c412665c28f3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:44.978034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:44.979539 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:44.993865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b6b3a-542c-49eb-bcd0-ac3ec3f33c15 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.055704 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.056344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.056620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.056890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] PATH_INFO: `/v3/projects/8eb09c09108945edb369ce2587d9e2c4` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.058003 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb09c09108945edb369ce2587d9e2c4)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.059988 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.108294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb09c09108945edb369ce2587d9e2c4', 'request_id': 'req-7204aa13-456a-4c24-8ce9-911d405547c8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.115081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb09c09108945edb369ce2587d9e2c4', 'request_id': 'req-7204aa13-456a-4c24-8ce9-911d405547c8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.122808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb09c09108945edb369ce2587d9e2c4', 'request_id': 'req-7204aa13-456a-4c24-8ce9-911d405547c8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.137194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] The token cache is being invalidate because project 8eb09c09108945edb369ce2587d9e2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:45.137479 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.138136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7204aa13-456a-4c24-8ce9-911d405547c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.139631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1361/2701] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:44 2022] DELETE /identity/v3/projects/8eb09c09108945edb369ce2587d9e2c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:45.144604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.144894 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.145168 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.153186 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:45.169380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:45.170612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.233876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1341/2702] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:45.243860 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fd56-9061-47b9-a99d-4692bd56455b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.244228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fd56-9061-47b9-a99d-4692bd56455b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.244566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32fd56-9061-47b9-a99d-4692bd56455b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.262450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.263997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.264651 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-4f32fd56-9061-47b9-a99d-4692bd56455b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:45.265827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-4f32fd56-9061-47b9-a99d-4692bd56455b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.274809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1362/2703] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:45.278998 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32fd56-9061-47b9-a99d-4692bd56455b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.280962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8a04e-cd5a-487b-aaa7-2b05f6105e40 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.286491 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.287195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.287543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.287877 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] PATH_INFO: `/v3/projects/40547ff808d8406e9bbb90dd5f8111da` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.289091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40547ff808d8406e9bbb90dd5f8111da)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.289329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32fd56-9061-47b9-a99d-4692bd56455b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.291269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.294901 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.295619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.296080 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.296365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.297133 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:45.297497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.299639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.306815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:45.313909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1363/2704] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:08:45.319357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.331608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120830-95bf-46a5-83ba-d8aac5d8e0ab admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.345379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40547ff808d8406e9bbb90dd5f8111da', 'request_id': 'req-a8184b13-ace5-4293-971b-cc4bae4cec09'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.352965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40547ff808d8406e9bbb90dd5f8111da', 'request_id': 'req-a8184b13-ace5-4293-971b-cc4bae4cec09'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.359676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40547ff808d8406e9bbb90dd5f8111da', 'request_id': 'req-a8184b13-ace5-4293-971b-cc4bae4cec09'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.371133 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] The token cache is being invalidate because project 40547ff808d8406e9bbb90dd5f8111da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:45.371422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.372079 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a8184b13-ace5-4293-971b-cc4bae4cec09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:45.374195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1342/2705] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:45 2022] DELETE /identity/v3/projects/40547ff808d8406e9bbb90dd5f8111da => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:45.379358 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da5ff-776b-49e2-b4dc-2777736185b8 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.379645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da5ff-776b-49e2-b4dc-2777736185b8 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.379922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6da5ff-776b-49e2-b4dc-2777736185b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.391551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.392153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.392537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.392929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.393520 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.395469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.399090 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3b6da5ff-776b-49e2-b4dc-2777736185b8 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:45.400282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3b6da5ff-776b-49e2-b4dc-2777736185b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.408105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1343/2706] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:45.415832 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258bbd-e5ce-4a0f-9eab-a348ac693e0c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.416115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258bbd-e5ce-4a0f-9eab-a348ac693e0c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.416466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258bbd-e5ce-4a0f-9eab-a348ac693e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.428886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1364/2707] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:45.429875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.431559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.436634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-39258bbd-e5ce-4a0f-9eab-a348ac693e0c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:45.437803 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-39258bbd-e5ce-4a0f-9eab-a348ac693e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.495469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b3805-5fad-4dcc-9b71-274414526534 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.498399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1344/2708] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:45.500147 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.500736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.501008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.501274 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.502720 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.503355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39258bbd-e5ce-4a0f-9eab-a348ac693e0c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.504667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.512323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39258bbd-e5ce-4a0f-9eab-a348ac693e0c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.517582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.518371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.518692 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.519030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.519807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:45.520139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.521739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.530772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1365/2709] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:45.531811 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.534021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1345/2710] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:08:45.538160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.542571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f169a-57ee-44ae-bcec-1e4dca446f2d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.547249 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.547841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.548120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.548390 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.548493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61983564-d695-4003-af7e-f3f13202a0b6 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.549906 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.551563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.553617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.554340 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.554617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.554887 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.555533 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.557405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.561557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1366/2711] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:45.561902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:45.566384 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.577182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a2263-7aaa-424d-ba5e-0ff6c7c6d67f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.582115 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.582711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.582983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.583251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.583878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.585457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.590376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1346/2712] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:45.591298 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.597932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1367/2713] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:45.600357 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.609626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5e91c-d7c5-4058-ab51-165d08c82791 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.654626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36120313-0e9d-4abb-8595-2ef7d62db92b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.657664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:45.660505 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.661166 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.661445 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.661715 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.662427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.664624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.669603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda86ccf-5b8b-4d2b-b1db-68e345256a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.670286 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda86ccf-5b8b-4d2b-b1db-68e345256a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.670563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda86ccf-5b8b-4d2b-b1db-68e345256a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.671043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda86ccf-5b8b-4d2b-b1db-68e345256a2a admin admin] PATH_INFO: `/v3/projects/21561f0e54c84bb1adcd76d589e19f8b/users/605b254e08804704bc483c96120463a8/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.687208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1347/2714] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:45.691359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.692243 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda86ccf-5b8b-4d2b-b1db-68e345256a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21561f0e54c84bb1adcd76d589e19f8b, user_id=605b254e08804704bc483c96120463a8, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.694909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda86ccf-5b8b-4d2b-b1db-68e345256a2a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.706969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90ed90-68ae-4391-a6ec-27317a97f45f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.709114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1368/2715] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:45 2022] PUT /identity/v3/projects/21561f0e54c84bb1adcd76d589e19f8b/users/605b254e08804704bc483c96120463a8/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:45.719350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8ee06-0794-45f5-aa2d-a8dd4662d9ff None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.719631 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8ee06-0794-45f5-aa2d-a8dd4662d9ff None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.719917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8ee06-0794-45f5-aa2d-a8dd4662d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.747759 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3db8ee06-0794-45f5-aa2d-a8dd4662d9ff None None] MFA Rules not processed for user `605b254e08804704bc483c96120463a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:45.748978 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3db8ee06-0794-45f5-aa2d-a8dd4662d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.766404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.767017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.767294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.767652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.768344 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.769972 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.780626 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1348/2716] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:45.785066 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.794993 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a9a6-101b-41d0-be1c-74a4f7f26ff9 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.800937 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.801523 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.801807 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.802072 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.802732 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.804939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.815055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1349/2717] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:45.815945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1369/2718] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:45.819087 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.820190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8ee06-0794-45f5-aa2d-a8dd4662d9ff None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.829075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a63f3-4a28-4c11-92f2-902e7d26bb6f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.830658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8ee06-0794-45f5-aa2d-a8dd4662d9ff None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.833925 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.834592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.834870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.835098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c94f6-8058-4584-8d0c-6ecd9a394dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.835215 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] PATH_INFO: `/v3/projects/48250b33353a46b6b110922b2ac37fa5/users/971f8d247e2e40f48e1dd1dccc7d5461/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.835679 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c94f6-8058-4584-8d0c-6ecd9a394dca admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.835954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c94f6-8058-4584-8d0c-6ecd9a394dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.836222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c94f6-8058-4584-8d0c-6ecd9a394dca admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.836836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c94f6-8058-4584-8d0c-6ecd9a394dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.838752 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c94f6-8058-4584-8d0c-6ecd9a394dca admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.850357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48250b33353a46b6b110922b2ac37fa5, user_id=971f8d247e2e40f48e1dd1dccc7d5461, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:45.852962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:45.865627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1350/2719] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:45 2022] PUT /identity/v3/projects/48250b33353a46b6b110922b2ac37fa5/users/971f8d247e2e40f48e1dd1dccc7d5461/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:45.875413 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1370/2720] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:45.875532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.877732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca85e-3540-49ee-9d7d-a5700455e42d None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.878020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca85e-3540-49ee-9d7d-a5700455e42d None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.878327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ca85e-3540-49ee-9d7d-a5700455e42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.906146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-935ca85e-3540-49ee-9d7d-a5700455e42d None None] MFA Rules not processed for user `971f8d247e2e40f48e1dd1dccc7d5461`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:45.907278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-935ca85e-3540-49ee-9d7d-a5700455e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:45.911319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:45.936781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398517e-1744-4ebe-ad34-174a69121d41 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:45.973290 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1371/2721] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:45.978572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca85e-3540-49ee-9d7d-a5700455e42d None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:45.996790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:45.997520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:45.997895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:45.998286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:45.999006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.000898 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.014485 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:46.024544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1351/2722] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:46.028579 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.038950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799cc5-fc36-44e2-8e29-785b4bd3df86 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.043658 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.044311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.044659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.045016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.045724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.045884 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ca85e-3540-49ee-9d7d-a5700455e42d None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.047334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.051319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.051913 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.052189 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.052455 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.053071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.055002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.058233 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1352/2723] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:46.062317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.072873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022165e0-0f06-4199-ab58-1f96a28beed6 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.077844 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.078613 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.078893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.079172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] PATH_INFO: `/v3/projects/bacf3f5308f34fb6b4588f3a30fc6132/users/aad2fd4a579d45cab3466024d1c6b00b/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.083171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1372/2724] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:45 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:46.087221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.103124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacf3f5308f34fb6b4588f3a30fc6132, user_id=aad2fd4a579d45cab3466024d1c6b00b, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.105853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.119589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1353/2725] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:46 2022] PUT /identity/v3/projects/bacf3f5308f34fb6b4588f3a30fc6132/users/aad2fd4a579d45cab3466024d1c6b00b/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:46.123453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.151446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8b9d-b80c-41de-8b42-a5906954fe00 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.187630 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16690eab-2bf5-444b-97ca-e92a0b178b8a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.192960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.193561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.193847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.194142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.194790 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.196401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.207483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1354/2726] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:46.210654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.211264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.211542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.211678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.211835 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.212459 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.214383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.221477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab3a23-e4f6-43dc-9601-cdacf38db263 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.226592 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed634c7-c3a6-48b6-accb-bc84c770e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.227443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed634c7-c3a6-48b6-accb-bc84c770e112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.227749 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed634c7-c3a6-48b6-accb-bc84c770e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.228083 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed634c7-c3a6-48b6-accb-bc84c770e112 admin admin] PATH_INFO: `/v3/projects/bacf3f5308f34fb6b4588f3a30fc6132/users/aad2fd4a579d45cab3466024d1c6b00b/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.230531 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed634c7-c3a6-48b6-accb-bc84c770e112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacf3f5308f34fb6b4588f3a30fc6132, user_id=aad2fd4a579d45cab3466024d1c6b00b, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.233460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed634c7-c3a6-48b6-accb-bc84c770e112 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.240152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1373/2727] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:46 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:46.241144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.244740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1355/2728] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:46 2022] PUT /identity/v3/projects/bacf3f5308f34fb6b4588f3a30fc6132/users/aad2fd4a579d45cab3466024d1c6b00b/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:46.250898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145803f5-7acd-4c87-96a1-20278b7392f5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.255591 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.255883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.256161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.283826 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] MFA Rules not processed for user `aad2fd4a579d45cab3466024d1c6b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:46.285046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:46.293222 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:46.300642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:46.311545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.312161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.312436 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.312706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.313349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.315574 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.325623 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1374/2729] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:46.329917 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.340417 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3793233-bde3-4148-88d0-98314e4d30f8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.345194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.346378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.346665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.346930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] PATH_INFO: `/v3/projects/c915b76da46642929381c45d2012f13d/users/e6c188ed5c604716bc943019b58b659e/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.358136 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1356/2730] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:46.366123 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c915b76da46642929381c45d2012f13d, user_id=e6c188ed5c604716bc943019b58b659e, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.368644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.369272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.370096 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:46.383746 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1375/2731] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:46 2022] PUT /identity/v3/projects/c915b76da46642929381c45d2012f13d/users/e6c188ed5c604716bc943019b58b659e/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:46.387642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.430475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18eaa5-9d79-481b-8333-178b9cffe10e None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.451647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ec328-6e46-42b8-8dfe-81dc8d8ed9c0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.456966 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.457565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.457844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.458141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.458797 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.461332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.471664 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1376/2732] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:46.475755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.481781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.482426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.482709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.482988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.485266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eead22-8c94-4024-a425-253cf5b340b8 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.489957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb0f4-96db-479b-a13b-9850deae397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.490786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb0f4-96db-479b-a13b-9850deae397d admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.491063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb0f4-96db-479b-a13b-9850deae397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.491336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb0f4-96db-479b-a13b-9850deae397d admin admin] PATH_INFO: `/v3/projects/c915b76da46642929381c45d2012f13d/users/e6c188ed5c604716bc943019b58b659e/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.493275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb0f4-96db-479b-a13b-9850deae397d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c915b76da46642929381c45d2012f13d, user_id=e6c188ed5c604716bc943019b58b659e, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.495932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb0f4-96db-479b-a13b-9850deae397d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.508190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1377/2733] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:46 2022] PUT /identity/v3/projects/c915b76da46642929381c45d2012f13d/users/e6c188ed5c604716bc943019b58b659e/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:46.519064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1bff4-08af-4606-964f-8424be57c10e None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.519356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1bff4-08af-4606-964f-8424be57c10e None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.519628 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1bff4-08af-4606-964f-8424be57c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.547572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-25b1bff4-08af-4606-964f-8424be57c10e None None] MFA Rules not processed for user `e6c188ed5c604716bc943019b58b659e`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:46.548944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-25b1bff4-08af-4606-964f-8424be57c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:46.555528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.556961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.567143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1357/2734] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:46.620757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1378/2735] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:46.632371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.633783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:46.645672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c79f1a-b185-4b2e-95ab-516ea1a523ba service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.653917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=100 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:46.672779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1bff4-08af-4606-964f-8424be57c10e None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:46.698596 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.699293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.699638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.699975 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.709712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:46.711195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.712796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.723628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1358/2736] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:46.731084 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1bff4-08af-4606-964f-8424be57c10e None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:46.735257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4ddb3-394f-4ee8-a106-50ed3d6c0870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:46.735514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ddb3-394f-4ee8-a106-50ed3d6c0870 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:46.735634 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ddb3-394f-4ee8-a106-50ed3d6c0870 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:46.735847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4ddb3-394f-4ee8-a106-50ed3d6c0870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:46.795354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4ddb3-394f-4ee8-a106-50ed3d6c0870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:46.796890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4ddb3-394f-4ee8-a106-50ed3d6c0870 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:46.806822 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1379/2737] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:47.122958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:47.188426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4148e-2b9f-4bdd-a66a-f9d3d01d34cb service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:47.193840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:47.194483 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:47.194758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:47.195021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] PATH_INFO: `/v3/users/971f8d247e2e40f48e1dd1dccc7d5461` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:47.196111 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971f8d247e2e40f48e1dd1dccc7d5461)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:47.198297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:47.243702 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971f8d247e2e40f48e1dd1dccc7d5461'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.250627 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971f8d247e2e40f48e1dd1dccc7d5461'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.251260 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971f8d247e2e40f48e1dd1dccc7d5461'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.258726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971f8d247e2e40f48e1dd1dccc7d5461'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.270982 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971f8d247e2e40f48e1dd1dccc7d5461'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.276700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1359/2738] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:47 2022] DELETE /identity/v3/users/971f8d247e2e40f48e1dd1dccc7d5461 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:47.281214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:47.281498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:47.281772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:47.300715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:47.301903 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:47.360561 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1380/2739] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:47.370221 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:47.371668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:47.407771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:47.430875 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cc676-329d-4f0f-b651-262a5d348893 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:47.434551 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:47.435130 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:47.435411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:47.435682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:47.445330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:47.446783 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:47.456477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1360/2740] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:47.730840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:47.732343 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:47.745956 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c4ce4-1c1d-4945-8565-418043acf59b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:47.750570 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:47.751200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:47.751476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:47.751774 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] PATH_INFO: `/v3/projects/48250b33353a46b6b110922b2ac37fa5` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:47.753911 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=48250b33353a46b6b110922b2ac37fa5)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:47.755974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:47.802929 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48250b33353a46b6b110922b2ac37fa5', 'request_id': 'req-366d16f4-c42f-4c69-bf32-3cea917494ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.808325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48250b33353a46b6b110922b2ac37fa5', 'request_id': 'req-366d16f4-c42f-4c69-bf32-3cea917494ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.814973 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48250b33353a46b6b110922b2ac37fa5', 'request_id': 'req-366d16f4-c42f-4c69-bf32-3cea917494ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.827405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] The token cache is being invalidate because project 48250b33353a46b6b110922b2ac37fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:47.827689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.828305 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.830001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1381/2741] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:47 2022] DELETE /identity/v3/projects/48250b33353a46b6b110922b2ac37fa5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:47.834043 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:47.843644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716f0af-dbee-4462-8c64-3f94fc0f0750 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:47.898688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:47.899311 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:47.899590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:47.899862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] PATH_INFO: `/v3/users/e6c188ed5c604716bc943019b58b659e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:47.900960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c188ed5c604716bc943019b58b659e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:47.902920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:47.947652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c188ed5c604716bc943019b58b659e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.954452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c188ed5c604716bc943019b58b659e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.955121 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c188ed5c604716bc943019b58b659e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.962107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c188ed5c604716bc943019b58b659e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.974436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a080b645-a311-4afa-9d4c-74a17d6ccc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c188ed5c604716bc943019b58b659e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:47.980258 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1361/2742] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:47 2022] DELETE /identity/v3/users/e6c188ed5c604716bc943019b58b659e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:48.259090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.260847 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:48.288198 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d16f4-c42f-4c69-bf32-3cea917494ea admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:48.297027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:48.357850 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:48.358710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.359034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.359335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] PATH_INFO: `/v3/projects/c915b76da46642929381c45d2012f13d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.360514 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c915b76da46642929381c45d2012f13d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:48.363226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:48.412725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c915b76da46642929381c45d2012f13d', 'request_id': 'req-13d18109-d517-4035-b707-9e37e99e2ccb'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:48.418301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c915b76da46642929381c45d2012f13d', 'request_id': 'req-13d18109-d517-4035-b707-9e37e99e2ccb'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:48.425804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c915b76da46642929381c45d2012f13d', 'request_id': 'req-13d18109-d517-4035-b707-9e37e99e2ccb'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:48.438039 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] The token cache is being invalidate because project c915b76da46642929381c45d2012f13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:48.438419 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:48.439024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-13d18109-d517-4035-b707-9e37e99e2ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:48.441330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1382/2743] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:48 2022] DELETE /identity/v3/projects/c915b76da46642929381c45d2012f13d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:48.447446 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bd47d-878b-4d62-84ed-9740c8e1d068 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.447908 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bd47d-878b-4d62-84ed-9740c8e1d068 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.448007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bd47d-878b-4d62-84ed-9740c8e1d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.467949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-483bd47d-878b-4d62-84ed-9740c8e1d068 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:48.469158 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-483bd47d-878b-4d62-84ed-9740c8e1d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:48.519773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:48.533318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1362/2744] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:48.542741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338b9c0-97ea-40ca-bce7-057d43f1b5cc None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.543024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338b9c0-97ea-40ca-bce7-057d43f1b5cc None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.543295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338b9c0-97ea-40ca-bce7-057d43f1b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.563150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3338b9c0-97ea-40ca-bce7-057d43f1b5cc None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:48.565015 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3338b9c0-97ea-40ca-bce7-057d43f1b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:48.573566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1383/2745] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:48.577722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bd47d-878b-4d62-84ed-9740c8e1d068 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.588681 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bd47d-878b-4d62-84ed-9740c8e1d068 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:48.593293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:48.593892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.594208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.594485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.595129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:48.595981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:48.597974 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:48.610464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1363/2746] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:08:48.615279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338b9c0-97ea-40ca-bce7-057d43f1b5cc None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.624758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338b9c0-97ea-40ca-bce7-057d43f1b5cc None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:48.629817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:48.630582 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.630857 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.631135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.631758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:48.633667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:48.660237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1384/2747] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:48 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:48.664583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.675349 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84475dea-b014-4726-a507-7cbedb422cbe admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:48.730722 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:48.731326 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.731609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.731881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.732512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:48.734460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:48.755660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1364/2748] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:48 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:48.759732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.769935 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960624c-4d27-4e63-a390-e04afaf1e4d9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:48.774494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:48.775104 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.775406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.775670 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.776295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:48.777868 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:48.788146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1385/2749] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:48.792016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.802423 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31af258-2d19-4494-92fe-afc0f9d8ccf8 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:48.806978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dd3f3-df4b-4cb2-a6f9-6c5094efa590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:48.807565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd3f3-df4b-4cb2-a6f9-6c5094efa590 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.807847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd3f3-df4b-4cb2-a6f9-6c5094efa590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.808118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd3f3-df4b-4cb2-a6f9-6c5094efa590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.808751 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dd3f3-df4b-4cb2-a6f9-6c5094efa590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:48.810360 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dd3f3-df4b-4cb2-a6f9-6c5094efa590 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:48.820718 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1365/2750] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:48.824875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.834889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03008e53-3ff3-4c29-8257-ab053dea24db admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:48.839483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:48.840065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.840346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.840620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] PATH_INFO: `/v3/projects/231459fce8c144898f35ab0df3550a67/users/9f4099efa6b6476096bfea5d29aaa323/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.856420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231459fce8c144898f35ab0df3550a67, user_id=9f4099efa6b6476096bfea5d29aaa323, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:48.859093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:48.872780 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1386/2751] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:48 2022] PUT /identity/v3/projects/231459fce8c144898f35ab0df3550a67/users/9f4099efa6b6476096bfea5d29aaa323/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:48.883173 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add84f26-4f2c-40ff-acf2-b6c045b399d6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:48.883455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add84f26-4f2c-40ff-acf2-b6c045b399d6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:48.883726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add84f26-4f2c-40ff-acf2-b6c045b399d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:48.911028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-add84f26-4f2c-40ff-acf2-b6c045b399d6 None None] MFA Rules not processed for user `9f4099efa6b6476096bfea5d29aaa323`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:48.912223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-add84f26-4f2c-40ff-acf2-b6c045b399d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:48.975296 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1366/2752] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:48.986396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:48.988184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.029336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:49.046190 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc712b-ed81-4b6c-bd93-df004ae6dd42 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:49.049841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54512bf9-22db-464f-bf9d-3a836304f255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:49.050467 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54512bf9-22db-464f-bf9d-3a836304f255 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.050749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54512bf9-22db-464f-bf9d-3a836304f255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.051022 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54512bf9-22db-464f-bf9d-3a836304f255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.059252 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54512bf9-22db-464f-bf9d-3a836304f255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:49.060672 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54512bf9-22db-464f-bf9d-3a836304f255 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:49.069424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1387/2753] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:49.088918 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add84f26-4f2c-40ff-acf2-b6c045b399d6 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:49.139387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:49.152371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add84f26-4f2c-40ff-acf2-b6c045b399d6 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:49.157218 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:49.157836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.158178 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.158480 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] PATH_INFO: `/v3/users/9f4099efa6b6476096bfea5d29aaa323` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.159663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4099efa6b6476096bfea5d29aaa323)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:49.161593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:49.209605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4099efa6b6476096bfea5d29aaa323'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.216583 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4099efa6b6476096bfea5d29aaa323'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.217291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4099efa6b6476096bfea5d29aaa323'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.224203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4099efa6b6476096bfea5d29aaa323'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.235793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4099efa6b6476096bfea5d29aaa323'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.242449 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1367/2754] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:49 2022] DELETE /identity/v3/users/9f4099efa6b6476096bfea5d29aaa323 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:49.246858 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.247146 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.247420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.266841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:49.268065 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.326482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1388/2755] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:49.335912 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:49.337292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.394521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1440350-1959-4f09-ab6d-735d3528f1cc admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:49.398110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313e422-300a-4a14-9061-87241dacb068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:49.398716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313e422-300a-4a14-9061-87241dacb068 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.398988 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313e422-300a-4a14-9061-87241dacb068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.399255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313e422-300a-4a14-9061-87241dacb068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.409387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313e422-300a-4a14-9061-87241dacb068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:49.410835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313e422-300a-4a14-9061-87241dacb068 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:49.420495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1368/2756] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:49.421311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:49.422709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.435257 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd1980-8125-4fed-adac-f960bd8aea3f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:49.440170 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:49.440802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.441075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.441346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] PATH_INFO: `/v3/users/605b254e08804704bc483c96120463a8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.442515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] RBAC: Authorizing `identity:delete_user(user_id=605b254e08804704bc483c96120463a8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:49.444426 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:49.494879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605b254e08804704bc483c96120463a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.502990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605b254e08804704bc483c96120463a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.515932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605b254e08804704bc483c96120463a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.516583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605b254e08804704bc483c96120463a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.523675 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605b254e08804704bc483c96120463a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.533983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1389/2757] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:49 2022] DELETE /identity/v3/users/605b254e08804704bc483c96120463a8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:49.538535 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.539051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.539187 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.558710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:49.559899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.629075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1369/2758] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:49.638796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:49.640273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.707779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebd35c-924e-4738-9ab4-14c1ce35527c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:49.711211 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:49.711932 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8166d0-cdff-4047-959b-1be6c40e3c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:49.712540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8166d0-cdff-4047-959b-1be6c40e3c61 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.712975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8166d0-cdff-4047-959b-1be6c40e3c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.713093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.713275 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8166d0-cdff-4047-959b-1be6c40e3c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.722033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:49.725396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8166d0-cdff-4047-959b-1be6c40e3c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:49.727460 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8166d0-cdff-4047-959b-1be6c40e3c61 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:49.738418 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ac8c4-b640-4392-b374-c3c91b25d9c4 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:49.741023 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1390/2759] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:49.743414 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:49.744055 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.744335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.744609 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] PATH_INFO: `/v3/projects/231459fce8c144898f35ab0df3550a67` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.745770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231459fce8c144898f35ab0df3550a67)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:49.747711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:49.757526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:49.799504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231459fce8c144898f35ab0df3550a67', 'request_id': 'req-69836a75-16e4-451b-8626-19ca994c7ec7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.806835 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231459fce8c144898f35ab0df3550a67', 'request_id': 'req-69836a75-16e4-451b-8626-19ca994c7ec7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.813637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231459fce8c144898f35ab0df3550a67', 'request_id': 'req-69836a75-16e4-451b-8626-19ca994c7ec7'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.826095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] The token cache is being invalidate because project 231459fce8c144898f35ab0df3550a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:49.826496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.827212 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-69836a75-16e4-451b-8626-19ca994c7ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:49.828719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1370/2760] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:49 2022] DELETE /identity/v3/projects/231459fce8c144898f35ab0df3550a67 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:49.833608 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bcc91-0529-4dfc-9ce1-1ca44664533f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.834137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bcc91-0529-4dfc-9ce1-1ca44664533f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.834314 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709bcc91-0529-4dfc-9ce1-1ca44664533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.854967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-709bcc91-0529-4dfc-9ce1-1ca44664533f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:49.856266 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-709bcc91-0529-4dfc-9ce1-1ca44664533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.924598 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1391/2761] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:49.932291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d203d3-674e-4a1b-840a-4b542858d54d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.932577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d203d3-674e-4a1b-840a-4b542858d54d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.932850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d203d3-674e-4a1b-840a-4b542858d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.952525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-f0d203d3-674e-4a1b-840a-4b542858d54d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:49.953820 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f0d203d3-674e-4a1b-840a-4b542858d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:49.962780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1371/2762] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:49.967089 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bcc91-0529-4dfc-9ce1-1ca44664533f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:49.977667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709bcc91-0529-4dfc-9ce1-1ca44664533f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:49.982495 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:49.983090 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:49.983365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:49.983633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:49.984295 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:49.984596 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:49.986210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:49.999465 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1392/2763] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:08:50.004318 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d203d3-674e-4a1b-840a-4b542858d54d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.014589 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d203d3-674e-4a1b-840a-4b542858d54d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.020752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.021374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.021648 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.021917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.022853 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.023825 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.024584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.025658 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.045393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90426456-4cb7-499f-a061-6acf8e6e266e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.050852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.051484 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.051786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.052046 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] PATH_INFO: `/v3/projects/21561f0e54c84bb1adcd76d589e19f8b` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.053322 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21561f0e54c84bb1adcd76d589e19f8b)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.055191 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.057425 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1372/2764] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:50 2022] POST /identity/v3/projects => generated 359 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:50.061752 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.108048 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21561f0e54c84bb1adcd76d589e19f8b', 'request_id': 'req-d9b70830-8521-4ebd-a447-d325708b6131'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.114067 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21561f0e54c84bb1adcd76d589e19f8b', 'request_id': 'req-d9b70830-8521-4ebd-a447-d325708b6131'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.121517 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21561f0e54c84bb1adcd76d589e19f8b', 'request_id': 'req-d9b70830-8521-4ebd-a447-d325708b6131'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.128287 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2999c7-d643-4b7b-9dd6-229088c697e4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.136070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] The token cache is being invalidate because project 21561f0e54c84bb1adcd76d589e19f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:50.136364 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.137011 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.138545 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1393/2765] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:50 2022] DELETE /identity/v3/projects/21561f0e54c84bb1adcd76d589e19f8b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:50.143227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.144601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.185962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.186518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.186796 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.187069 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.187693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.190225 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.211696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b70830-8521-4ebd-a447-d325708b6131 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.212493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1373/2766] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:50 2022] POST /identity/v3/users => generated 280 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:50.216518 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.216668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.217301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.217569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.217841 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] PATH_INFO: `/v3/users/aad2fd4a579d45cab3466024d1c6b00b` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.218387 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.219245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad2fd4a579d45cab3466024d1c6b00b)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.221536 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.227002 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:50.227767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:50.231134 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5545570-cb14-4b93-8590-425d4272b99b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.237671 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.238288 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.238581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.238860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.239758 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.241532 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.252549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1374/2767] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:50.256408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.265936 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94d21-7854-4899-8314-8e0c95eb23b7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.271384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.271964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.272244 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.272537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.273162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.273887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad2fd4a579d45cab3466024d1c6b00b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.274765 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.281335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad2fd4a579d45cab3466024d1c6b00b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.285571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1375/2768] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:50.289512 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.294244 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad2fd4a579d45cab3466024d1c6b00b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.294842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad2fd4a579d45cab3466024d1c6b00b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.298944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554b22-0206-46cb-b60f-d14917936e72 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.302100 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f1fd0359-35e6-47fd-9266-d6a60453f41f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad2fd4a579d45cab3466024d1c6b00b'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.303541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.304164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.304439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.304710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] PATH_INFO: `/v3/projects/357299958b404aada2eff70c9a0a4de8/users/a8e82190820c4ebf9cbae51e5af4f0a8/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.308099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1394/2769] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:50 2022] DELETE /identity/v3/users/aad2fd4a579d45cab3466024d1c6b00b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:50.320900 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=357299958b404aada2eff70c9a0a4de8, user_id=a8e82190820c4ebf9cbae51e5af4f0a8, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.323966 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.337712 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1376/2770] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:50 2022] PUT /identity/v3/projects/357299958b404aada2eff70c9a0a4de8/users/a8e82190820c4ebf9cbae51e5af4f0a8/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:50.348717 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.349005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.349273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.379347 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] MFA Rules not processed for user `a8e82190820c4ebf9cbae51e5af4f0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:50.380814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.448061 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1395/2771] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:50.487363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.488892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.548223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c968a-ca53-4bca-b890-6b747d585f3c admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.553017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.553620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.553902 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.554208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.562885 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.564909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.574416 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1377/2772] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:50.590701 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.592375 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.609051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.610761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.668960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9f3c8-8561-4669-bbaf-3dee510b5a0b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.674407 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.675033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.675311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.675580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] PATH_INFO: `/v3/users/a8e82190820c4ebf9cbae51e5af4f0a8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.676714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e82190820c4ebf9cbae51e5af4f0a8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.678689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.695702 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:50.696680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b7e37-6be6-481a-b5fe-e03084935761 service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.703817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.704307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.704584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.704909 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] PATH_INFO: `/v3/projects/bacf3f5308f34fb6b4588f3a30fc6132` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.706056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacf3f5308f34fb6b4588f3a30fc6132)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.708021 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.743405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e82190820c4ebf9cbae51e5af4f0a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.750990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e82190820c4ebf9cbae51e5af4f0a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.760582 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacf3f5308f34fb6b4588f3a30fc6132', 'request_id': 'req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.764686 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e82190820c4ebf9cbae51e5af4f0a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.765392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e82190820c4ebf9cbae51e5af4f0a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.768828 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacf3f5308f34fb6b4588f3a30fc6132', 'request_id': 'req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.773826 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-04d19228-9a18-418d-9360-1c456336eae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e82190820c4ebf9cbae51e5af4f0a8'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.775259 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacf3f5308f34fb6b4588f3a30fc6132', 'request_id': 'req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.777199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:50.780915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1396/2773] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:50 2022] DELETE /identity/v3/users/a8e82190820c4ebf9cbae51e5af4f0a8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:50.785328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.785610 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.785888 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.790008 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] The token cache is being invalidate because project bacf3f5308f34fb6b4588f3a30fc6132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:50.790401 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.791160 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-9b7717a0-e4f7-49bf-9b2a-3f4fe5ff9a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:50.792711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1378/2774] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:50 2022] DELETE /identity/v3/projects/bacf3f5308f34fb6b4588f3a30fc6132 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:50.797568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965105-70ce-41d9-8f9a-7ea48f4542c1 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.797856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965105-70ce-41d9-8f9a-7ea48f4542c1 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.798161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77965105-70ce-41d9-8f9a-7ea48f4542c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.805294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:50.806535 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.818665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-77965105-70ce-41d9-8f9a-7ea48f4542c1 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:50.819839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-77965105-70ce-41d9-8f9a-7ea48f4542c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.868073 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1397/2775] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:50.877944 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.879349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.882740 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1379/2776] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:50.891355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7860e-c3ca-4b81-a732-5c5ccdcf4b3a None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.891641 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7860e-c3ca-4b81-a732-5c5ccdcf4b3a None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.891917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7860e-c3ca-4b81-a732-5c5ccdcf4b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.912748 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-19e7860e-c3ca-4b81-a732-5c5ccdcf4b3a None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:50.913956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-19e7860e-c3ca-4b81-a732-5c5ccdcf4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:50.922666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1380/2777] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:50.927116 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7860e-c3ca-4b81-a732-5c5ccdcf4b3a None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.936192 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7860e-c3ca-4b81-a732-5c5ccdcf4b3a None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.937518 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af8b69-a09b-4ca4-95d9-bd458ea2a796 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.941265 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.941860 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.942164 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.942296 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.942426 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.943034 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.943147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:50.943413 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.943515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.943848 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.944990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.954200 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.955650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:50.957429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1381/2778] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:08:50.961689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:50.965558 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1398/2779] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:50.972330 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5af91-f48f-4516-98bc-98b497070355 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:50.977104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:50.977690 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:50.977964 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:50.978269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:50.978890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:50.980911 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.010575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1382/2780] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:50 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:51.014643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.025207 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c404e1-3b54-4d10-95b4-0e650e3553de service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.062447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:51.087871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.088477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.088756 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.089025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.089659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.091594 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.116167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1399/2781] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:51.122327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.134115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b437b1-7ed6-4259-b0fc-f6988fdc18da admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.138994 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.139594 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.139870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.140139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.140773 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.143000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.153544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1383/2782] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:51.157647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.168044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0271e-9905-4195-9e8d-4b3d7991e0e9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.172613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cd793-f66f-43cd-8adc-6fd05b9e24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.173209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd793-f66f-43cd-8adc-6fd05b9e24be admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.174150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd793-f66f-43cd-8adc-6fd05b9e24be admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.174303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd793-f66f-43cd-8adc-6fd05b9e24be admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.174999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cd793-f66f-43cd-8adc-6fd05b9e24be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.176849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cd793-f66f-43cd-8adc-6fd05b9e24be admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.192178 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1400/2783] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:51.193404 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.203813 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f53b05-bab0-4157-9a87-fee4ed384dd3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.210001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.210672 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.210971 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.211309 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] PATH_INFO: `/v3/projects/164107726851440c84f927ba2bc5080a/users/400f9832955e4a35a241f788925619ea/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.226422 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=164107726851440c84f927ba2bc5080a, user_id=400f9832955e4a35a241f788925619ea, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.229200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.244408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1384/2784] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:51 2022] PUT /identity/v3/projects/164107726851440c84f927ba2bc5080a/users/400f9832955e4a35a241f788925619ea/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:51.256749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d1d6-6a22-4cc7-b8be-595329e4715c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.256749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d1d6-6a22-4cc7-b8be-595329e4715c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.256749 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70d1d6-6a22-4cc7-b8be-595329e4715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.257919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.259998 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:51.287815 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-8d70d1d6-6a22-4cc7-b8be-595329e4715c None None] MFA Rules not processed for user `400f9832955e4a35a241f788925619ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:51.289385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8d70d1d6-6a22-4cc7-b8be-595329e4715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:51.336273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82305f13-4f10-4357-bf56-a40ac18f15c4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.341091 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.341719 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.342001 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.342313 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] PATH_INFO: `/v3/projects/357299958b404aada2eff70c9a0a4de8` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.343440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=357299958b404aada2eff70c9a0a4de8)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.345348 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.355748 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1401/2785] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:51.360074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70d1d6-6a22-4cc7-b8be-595329e4715c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.363106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:51.371232 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70d1d6-6a22-4cc7-b8be-595329e4715c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.376183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.377326 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.377744 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.378213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.378849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.380747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.395872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357299958b404aada2eff70c9a0a4de8', 'request_id': 'req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:51.404915 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357299958b404aada2eff70c9a0a4de8', 'request_id': 'req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:51.408409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1402/2786] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:51.411365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357299958b404aada2eff70c9a0a4de8', 'request_id': 'req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:51.412690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.422197 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] The token cache is being invalidate because project 357299958b404aada2eff70c9a0a4de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:51.422487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:51.423143 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-51f9f8d3-1fdd-49e4-b65f-eea57307f14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:51.425275 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1385/2787] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:51 2022] DELETE /identity/v3/projects/357299958b404aada2eff70c9a0a4de8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:51.431442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3aa9c-457b-4bfe-b14d-4e5a2bb6c077 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.431729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3aa9c-457b-4bfe-b14d-4e5a2bb6c077 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.432014 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3aa9c-457b-4bfe-b14d-4e5a2bb6c077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.452294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8bc3aa9c-457b-4bfe-b14d-4e5a2bb6c077 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:51.453499 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8bc3aa9c-457b-4bfe-b14d-4e5a2bb6c077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:51.476045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c377-99cc-4184-8fe5-15940ad03b74 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.480607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.481205 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.481489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.481753 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.482404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.484441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.511271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1403/2788] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:51.512352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.514040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:51.515307 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1386/2789] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:51.522948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ae61-7a75-4744-904d-5e487f1d8c1c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.523357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ae61-7a75-4744-904d-5e487f1d8c1c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.523640 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7ae61-7a75-4744-904d-5e487f1d8c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.529755 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95ea73-abd4-478a-964b-efcbfc4de51b admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.535103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.535698 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.535976 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.536247 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.536927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.538552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.543155 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-23f7ae61-7a75-4744-904d-5e487f1d8c1c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:51.544370 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-23f7ae61-7a75-4744-904d-5e487f1d8c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:51.552292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1404/2790] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:51.553298 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.554114 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1387/2791] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:51.557118 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7ae61-7a75-4744-904d-5e487f1d8c1c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.558497 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:51.565895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780af0-84cf-4e99-9a6b-833cff95a100 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.568181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7ae61-7a75-4744-904d-5e487f1d8c1c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.571024 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.571781 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.572066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.572604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] PATH_INFO: `/v3/projects/9de60cd255cf4b3cb96ceeb767abc500/users/495cbb8bc2374b8691c0b96b7c5fbdea/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.573016 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.573643 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.573930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.574232 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.574883 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:51.575177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.576762 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.588417 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1388/2792] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:08:51.588895 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de60cd255cf4b3cb96ceeb767abc500, user_id=495cbb8bc2374b8691c0b96b7c5fbdea, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.591566 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.592782 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.603631 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8ceed-3d76-453a-a4ac-a82dbb2fd0af admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.606381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1405/2793] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:51 2022] PUT /identity/v3/projects/9de60cd255cf4b3cb96ceeb767abc500/users/495cbb8bc2374b8691c0b96b7c5fbdea/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:51.610066 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.665734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.666396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.666703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.667029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.667731 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.669710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.703688 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1389/2794] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:51.706059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.719666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:51.783389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6b73-9c9a-4f52-b27c-63e062a15663 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.788369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.789194 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.789470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.789745 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.790411 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.793059 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.795373 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b808bf-1f32-4986-bd31-9ec9e74653d0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.800764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.801365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.801648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.801909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.802580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.804157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.815063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1406/2795] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:51.815870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1390/2796] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:51.819406 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.819761 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.829646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcd95a-565a-4c2c-9487-226553837098 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.830402 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ec16-beb8-4505-880d-e5ff7e970be3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.834346 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.834980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.835254 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.835496 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2e7df-5af5-4379-9963-79dcfb4caebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.835609 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] PATH_INFO: `/v3/projects/9de60cd255cf4b3cb96ceeb767abc500/users/495cbb8bc2374b8691c0b96b7c5fbdea/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.836219 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e7df-5af5-4379-9963-79dcfb4caebe admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.836569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e7df-5af5-4379-9963-79dcfb4caebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.836914 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2e7df-5af5-4379-9963-79dcfb4caebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.837404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de60cd255cf4b3cb96ceeb767abc500, user_id=495cbb8bc2374b8691c0b96b7c5fbdea, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.837728 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2e7df-5af5-4379-9963-79dcfb4caebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.839415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2e7df-5af5-4379-9963-79dcfb4caebe admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.840005 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.853710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1407/2797] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:51 2022] PUT /identity/v3/projects/9de60cd255cf4b3cb96ceeb767abc500/users/495cbb8bc2374b8691c0b96b7c5fbdea/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:51.853892 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1391/2798] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:51.859094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.861948 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.862269 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.862541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.889926 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] MFA Rules not processed for user `495cbb8bc2374b8691c0b96b7c5fbdea`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:51.891703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:51.921385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09b5ff-7762-4300-a193-2b9e3533ae2e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.926890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.927494 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.927793 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.928062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.928693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.930388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.940783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1408/2799] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:51.944970 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.955344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6380bf-a469-4c61-a954-9503cdc813c0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:51.960044 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6809a-2dc8-46fe-b68d-638eb9d820b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:51.960700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6809a-2dc8-46fe-b68d-638eb9d820b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:51.960957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6809a-2dc8-46fe-b68d-638eb9d820b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:51.961239 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6809a-2dc8-46fe-b68d-638eb9d820b6 admin admin] PATH_INFO: `/v3/projects/4c35a23168b44a07baf9cc69914609c8/users/7abd9a1953f94860bac8e41360025f94/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:51.965240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1392/2800] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:51.977121 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6809a-2dc8-46fe-b68d-638eb9d820b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c35a23168b44a07baf9cc69914609c8, user_id=7abd9a1953f94860bac8e41360025f94, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:51.977264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:51.978563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:51.979775 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6809a-2dc8-46fe-b68d-638eb9d820b6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:51.992885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1409/2801] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:51 2022] PUT /identity/v3/projects/4c35a23168b44a07baf9cc69914609c8/users/7abd9a1953f94860bac8e41360025f94/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:52.003040 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:52.003323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:52.003617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:52.031666 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] MFA Rules not processed for user `7abd9a1953f94860bac8e41360025f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:52.032907 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:52.039921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca907d3-2372-4214-8d20-7ecc030466b2 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:52.054222 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:52.069230 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:52.092395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6603c-7830-4182-a2b9-34123be77faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:52.093003 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6603c-7830-4182-a2b9-34123be77faa service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:52.093284 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6603c-7830-4182-a2b9-34123be77faa service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:52.093852 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6603c-7830-4182-a2b9-34123be77faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:52.099330 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1410/2802] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:52.109880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:52.111287 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:52.122605 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bbad3-9a21-40e7-9ec5-78f630774300 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:52.126502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:52.127130 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:52.127404 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:52.127668 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:52.136383 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:52.137821 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:52.147516 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1411/2803] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:52.162201 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6603c-7830-4182-a2b9-34123be77faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:52.164267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6603c-7830-4182-a2b9-34123be77faa service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:52.173780 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1393/2804] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 15:08:52.727103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:52.788618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b1847-cf8a-4149-9f4c-ac95fd8d5bf7 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:52.793111 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:52.793721 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:52.793996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:52.794293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] PATH_INFO: `/v3/users/400f9832955e4a35a241f788925619ea` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:52.795385 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=400f9832955e4a35a241f788925619ea)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:52.797271 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:52.843227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400f9832955e4a35a241f788925619ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:52.850779 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400f9832955e4a35a241f788925619ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:52.862964 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400f9832955e4a35a241f788925619ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:52.863583 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400f9832955e4a35a241f788925619ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:52.870421 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400f9832955e4a35a241f788925619ea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:52.876204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1412/2805] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:52 2022] DELETE /identity/v3/users/400f9832955e4a35a241f788925619ea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:52.880705 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:52.881191 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:52.881292 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:52.900504 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:52.901704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:52.960104 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1394/2806] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:52.969644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:52.971613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:53.002725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:53.030534 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f58dbb-5c87-4f0c-ab10-830b00e46a0d admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:53.034855 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:53.035452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:53.035732 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:53.036006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:53.044918 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:53.046392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:53.055741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1413/2807] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:53.333997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:53.335441 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:53.347407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a930cb0-d209-4b67-b19e-752d57b391e9 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:53.352137 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:53.352793 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:53.353068 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:53.353339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] PATH_INFO: `/v3/projects/164107726851440c84f927ba2bc5080a` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:53.354520 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=164107726851440c84f927ba2bc5080a)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:53.356438 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:53.409922 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164107726851440c84f927ba2bc5080a', 'request_id': 'req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.418669 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164107726851440c84f927ba2bc5080a', 'request_id': 'req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.426839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164107726851440c84f927ba2bc5080a', 'request_id': 'req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.438375 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] The token cache is being invalidate because project 164107726851440c84f927ba2bc5080a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:53.438682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.440101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.442195 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1395/2808] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:53 2022] DELETE /identity/v3/projects/164107726851440c84f927ba2bc5080a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:53.446069 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:53.456527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42012936-1b80-438d-b4dd-fad789a6f482 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:53.515771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:53.516396 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:53.516692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:53.516960 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] PATH_INFO: `/v3/users/495cbb8bc2374b8691c0b96b7c5fbdea` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:53.518982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495cbb8bc2374b8691c0b96b7c5fbdea)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:53.520875 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:53.566678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495cbb8bc2374b8691c0b96b7c5fbdea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.574525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495cbb8bc2374b8691c0b96b7c5fbdea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.587265 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495cbb8bc2374b8691c0b96b7c5fbdea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.587923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495cbb8bc2374b8691c0b96b7c5fbdea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.595124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-e0947081-d4c0-4aa8-96b9-baaa8a7e98d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495cbb8bc2374b8691c0b96b7c5fbdea'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:53.601719 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1414/2809] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:53 2022] DELETE /identity/v3/users/495cbb8bc2374b8691c0b96b7c5fbdea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:53.906862 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:53.909262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:53.920077 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:53.928295 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4baed-fc2a-439c-860f-3d0d47ce55ac admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:53.992755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:53.993385 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:53.993842 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:53.994147 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] PATH_INFO: `/v3/projects/9de60cd255cf4b3cb96ceeb767abc500` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:53.995316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de60cd255cf4b3cb96ceeb767abc500)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:53.997264 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.044188 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de60cd255cf4b3cb96ceeb767abc500', 'request_id': 'req-1f73a092-84a1-495a-b470-6da25fbb902e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:54.052312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de60cd255cf4b3cb96ceeb767abc500', 'request_id': 'req-1f73a092-84a1-495a-b470-6da25fbb902e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:54.060182 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de60cd255cf4b3cb96ceeb767abc500', 'request_id': 'req-1f73a092-84a1-495a-b470-6da25fbb902e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:54.072950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] The token cache is being invalidate because project 9de60cd255cf4b3cb96ceeb767abc500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:54.073238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:54.074245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1f73a092-84a1-495a-b470-6da25fbb902e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:54.076735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1396/2810] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:53 2022] DELETE /identity/v3/projects/9de60cd255cf4b3cb96ceeb767abc500 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:54.081722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faadbb-34ce-45b3-a6ea-483a4f9ddf3b None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.082245 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faadbb-34ce-45b3-a6ea-483a4f9ddf3b None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.082362 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faadbb-34ce-45b3-a6ea-483a4f9ddf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.104213 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-48faadbb-34ce-45b3-a6ea-483a4f9ddf3b None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:54.105409 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-48faadbb-34ce-45b3-a6ea-483a4f9ddf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:54.153851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:54.170824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1415/2811] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:08:54.179893 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e125de7-5681-4242-be0d-316460c8013c None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.180263 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e125de7-5681-4242-be0d-316460c8013c None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.180742 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e125de7-5681-4242-be0d-316460c8013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.201380 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-7e125de7-5681-4242-be0d-316460c8013c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:54.202586 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-7e125de7-5681-4242-be0d-316460c8013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:54.211324 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1397/2812] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:54.215472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faadbb-34ce-45b3-a6ea-483a4f9ddf3b None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.226113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faadbb-34ce-45b3-a6ea-483a4f9ddf3b None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.230894 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.231515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.231801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.232074 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] PATH_INFO: `/v3/domains` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.232711 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81510) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:54.233013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.234642 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.246235 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1416/2813] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:08:54.250543 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e125de7-5681-4242-be0d-316460c8013c None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.259847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e125de7-5681-4242-be0d-316460c8013c None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.264460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.265075 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.265353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.265624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.266291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.268689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.295653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1398/2814] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:54 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:54.300151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.309972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9065b-928d-461f-a460-5a6fcafdf69a admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.366681 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.367278 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.367557 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.367828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.368449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.370372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.391167 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1417/2815] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:54 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:54.395822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.406073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648dfa1-1f4b-4e46-9cf9-abeef7a6f2a2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.411487 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.412085 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.412362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.412636 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.413277 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.414958 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.424889 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1399/2816] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:54.429182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.439288 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5250b-fe0b-41c5-aefe-e17e0de684f5 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.443941 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2869a-5d2a-4ac4-98a6-6bb7f4af1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.444531 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2869a-5d2a-4ac4-98a6-6bb7f4af1358 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.444807 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2869a-5d2a-4ac4-98a6-6bb7f4af1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.445077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2869a-5d2a-4ac4-98a6-6bb7f4af1358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.445710 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2869a-5d2a-4ac4-98a6-6bb7f4af1358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.447595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2869a-5d2a-4ac4-98a6-6bb7f4af1358 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.458699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1418/2817] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:54.462956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.473743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de23e2-3afe-42a0-89c9-329820d53ab2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.478359 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552046-914a-4620-95e0-38543127231d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.479004 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552046-914a-4620-95e0-38543127231d admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.479279 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552046-914a-4620-95e0-38543127231d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.479548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552046-914a-4620-95e0-38543127231d admin admin] PATH_INFO: `/v3/projects/fbfd21138c7e4140b8cc4547e10316a8/users/a534b47e20a54738a576fb3682e3c8ee/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.494335 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2552046-914a-4620-95e0-38543127231d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfd21138c7e4140b8cc4547e10316a8, user_id=a534b47e20a54738a576fb3682e3c8ee, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.496955 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2552046-914a-4620-95e0-38543127231d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.509390 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1400/2818] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:54 2022] PUT /identity/v3/projects/fbfd21138c7e4140b8cc4547e10316a8/users/a534b47e20a54738a576fb3682e3c8ee/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:54.521241 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af378-c368-4119-8905-67717fb9d91f None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.521528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af378-c368-4119-8905-67717fb9d91f None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.521802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af378-c368-4119-8905-67717fb9d91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.550229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-1a0af378-c368-4119-8905-67717fb9d91f None None] MFA Rules not processed for user `a534b47e20a54738a576fb3682e3c8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:54.551446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-1a0af378-c368-4119-8905-67717fb9d91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:54.616505 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1419/2819] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:54.621181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552046-914a-4620-95e0-38543127231d admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.654462 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:54.684577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552046-914a-4620-95e0-38543127231d admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.689666 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.690303 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.690581 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.690847 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.691474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.693376 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.720723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1401/2820] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:54 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:54.724983 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af378-c368-4119-8905-67717fb9d91f None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.735722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af378-c368-4119-8905-67717fb9d91f None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.778962 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:54.792735 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.793332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.793715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.793991 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] PATH_INFO: `/v3/users` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.794660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.796565 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.817617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1420/2821] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:54 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:54.821990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.833917 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ad200-eabf-4acf-a3ed-7e768f137f87 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.838502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.839084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.839357 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.839623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.840252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.841816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.852775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1402/2822] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:54.856754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.866739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77c58a-f5b2-4b85-af2f-7a2a0efe6c3c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.871319 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.871987 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.872267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.872540 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] PATH_INFO: `/v3/projects/dc3ab63802034f608ef63d4fffcc1eaa/users/9c55e49378ae45879c834f378a5591b4/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.887381 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3ab63802034f608ef63d4fffcc1eaa, user_id=9c55e49378ae45879c834f378a5591b4, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.889999 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.903530 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1421/2823] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:54 2022] PUT /identity/v3/projects/dc3ab63802034f608ef63d4fffcc1eaa/users/9c55e49378ae45879c834f378a5591b4/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:54.907509 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:54.917895 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88507683-814a-4cc2-9a9c-1745963ef0c5 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:54.975570 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c42598-71f3-49e2-bc4a-f5af4f1b9ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:54.976180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42598-71f3-49e2-bc4a-f5af4f1b9ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:54.976455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42598-71f3-49e2-bc4a-f5af4f1b9ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:54.976725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42598-71f3-49e2-bc4a-f5af4f1b9ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:54.977365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c42598-71f3-49e2-bc4a-f5af4f1b9ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:54.978996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c42598-71f3-49e2-bc4a-f5af4f1b9ccf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:54.992126 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1403/2824] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:54.993725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:55.004989 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a16ac-fc1f-4556-b9f2-0bc1dde8b77c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:55.009622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:55.010329 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:55.010604 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:55.010870 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] PATH_INFO: `/v3/projects/dc3ab63802034f608ef63d4fffcc1eaa/users/9c55e49378ae45879c834f378a5591b4/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:55.012804 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3ab63802034f608ef63d4fffcc1eaa, user_id=9c55e49378ae45879c834f378a5591b4, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:55.015469 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:55.026751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1422/2825] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:54 2022] PUT /identity/v3/projects/dc3ab63802034f608ef63d4fffcc1eaa/users/9c55e49378ae45879c834f378a5591b4/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:55.038498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020ae6-ac78-4a46-9a6b-eafc39450a23 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:55.038794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020ae6-ac78-4a46-9a6b-eafc39450a23 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:55.039071 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020ae6-ac78-4a46-9a6b-eafc39450a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:55.067170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8d020ae6-ac78-4a46-9a6b-eafc39450a23 None None] MFA Rules not processed for user `9c55e49378ae45879c834f378a5591b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:55.068383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8d020ae6-ac78-4a46-9a6b-eafc39450a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:55.137378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1404/2826] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:55.148502 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:55.150228 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:55.213013 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c3106-0caf-42f2-8e7e-0e19d569dfb3 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:55.216760 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77c0c0-5b6b-4500-bab2-3424a9c7280f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:55.217363 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c0c0-5b6b-4500-bab2-3424a9c7280f service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:55.217643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c0c0-5b6b-4500-bab2-3424a9c7280f service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:55.217915 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c0c0-5b6b-4500-bab2-3424a9c7280f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:55.227886 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77c0c0-5b6b-4500-bab2-3424a9c7280f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:55.229800 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77c0c0-5b6b-4500-bab2-3424a9c7280f service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:55.241251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1423/2827] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:55.666408 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d020ae6-ac78-4a46-9a6b-eafc39450a23 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:55.697139 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:55.730788 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d020ae6-ac78-4a46-9a6b-eafc39450a23 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:55.735170 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:55.735792 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:55.736171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:55.736599 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] PATH_INFO: `/v3/users/a534b47e20a54738a576fb3682e3c8ee` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:55.737711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a534b47e20a54738a576fb3682e3c8ee)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:55.739652 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:55.786747 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a534b47e20a54738a576fb3682e3c8ee'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:55.794154 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a534b47e20a54738a576fb3682e3c8ee'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:55.794756 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a534b47e20a54738a576fb3682e3c8ee'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:55.801843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a534b47e20a54738a576fb3682e3c8ee'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:55.813548 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a534b47e20a54738a576fb3682e3c8ee'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:55.819405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1405/2828] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:55 2022] DELETE /identity/v3/users/a534b47e20a54738a576fb3682e3c8ee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:55.824054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:55.824336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:55.824606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:55.843509 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:55.844696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:55.901789 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1424/2829] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:55.912056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:55.913481 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:55.974165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1126a-2c18-4b98-bdb2-dd77c4673f1b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:55.978046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:55.978665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:55.979027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:55.979297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:55.990028 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:55.991434 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:56.002208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1406/2830] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:56.274551 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:56.275994 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:56.288166 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239760d-5705-4af7-9201-8abe62c9cb18 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:56.292974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:56.293603 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:56.293883 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:56.294185 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] PATH_INFO: `/v3/projects/fbfd21138c7e4140b8cc4547e10316a8` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:56.295292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfd21138c7e4140b8cc4547e10316a8)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:56.297195 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:56.336160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:56.347002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfd21138c7e4140b8cc4547e10316a8', 'request_id': 'req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.354032 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfd21138c7e4140b8cc4547e10316a8', 'request_id': 'req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.360162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfd21138c7e4140b8cc4547e10316a8', 'request_id': 'req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.373144 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] The token cache is being invalidate because project fbfd21138c7e4140b8cc4547e10316a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:56.373441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.374054 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.375731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1425/2831] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:56 2022] DELETE /identity/v3/projects/fbfd21138c7e4140b8cc4547e10316a8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:56.380177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:56.394561 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e71f-8301-4876-9ca5-bfbc69497f36 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:56.444903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:56.459369 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:56.460000 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:56.460302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:56.460571 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] PATH_INFO: `/v3/users/9c55e49378ae45879c834f378a5591b4` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:56.461679 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c55e49378ae45879c834f378a5591b4)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:56.463584 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:56.513199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c55e49378ae45879c834f378a5591b4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.521249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c55e49378ae45879c834f378a5591b4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.521933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c55e49378ae45879c834f378a5591b4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.529665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c55e49378ae45879c834f378a5591b4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.543490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-dc6a4e92-e66e-439d-ab5a-28696c4676aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c55e49378ae45879c834f378a5591b4'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.549470 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1407/2832] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:08:56 2022] DELETE /identity/v3/users/9c55e49378ae45879c834f378a5591b4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:56.830004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:56.831768 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:56.863221 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3caa9b-2481-45f8-b3bd-a6587d32ead3 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:56.921512 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:56.922229 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:56.922507 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:56.922778 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] PATH_INFO: `/v3/projects/dc3ab63802034f608ef63d4fffcc1eaa` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:56.924633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3ab63802034f608ef63d4fffcc1eaa)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:56.926547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:56.975650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3ab63802034f608ef63d4fffcc1eaa', 'request_id': 'req-7c361fca-f359-4cb9-97ba-fab308b0a4fa'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.984633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3ab63802034f608ef63d4fffcc1eaa', 'request_id': 'req-7c361fca-f359-4cb9-97ba-fab308b0a4fa'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:56.991554 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3ab63802034f608ef63d4fffcc1eaa', 'request_id': 'req-7c361fca-f359-4cb9-97ba-fab308b0a4fa'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:57.004912 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] The token cache is being invalidate because project dc3ab63802034f608ef63d4fffcc1eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:08:57.005201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:57.005816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-7c361fca-f359-4cb9-97ba-fab308b0a4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:08:57.007351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1426/2833] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:08:56 2022] DELETE /identity/v3/projects/dc3ab63802034f608ef63d4fffcc1eaa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:57.012196 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af416-f795-48c7-8c97-3d5f8c3d0fb5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.012693 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af416-f795-48c7-8c97-3d5f8c3d0fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.012797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af416-f795-48c7-8c97-3d5f8c3d0fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.032459 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-077af416-f795-48c7-8c97-3d5f8c3d0fb5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:57.034216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-077af416-f795-48c7-8c97-3d5f8c3d0fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:57.100400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1408/2834] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:57.108294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3933e8-d6c7-4c6d-a4c2-f442e1bcb4ee None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.108694 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3933e8-d6c7-4c6d-a4c2-f442e1bcb4ee None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.109038 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3933e8-d6c7-4c6d-a4c2-f442e1bcb4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.130601 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-fc3933e8-d6c7-4c6d-a4c2-f442e1bcb4ee None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:57.131876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-fc3933e8-d6c7-4c6d-a4c2-f442e1bcb4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:57.140110 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1427/2835] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:57.144146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077af416-f795-48c7-8c97-3d5f8c3d0fb5 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:57.153931 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077af416-f795-48c7-8c97-3d5f8c3d0fb5 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:57.159054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:57.159653 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.159930 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.160199 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.160841 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:08:57.161148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:57.162794 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:57.175400 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1409/2836] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:08:57.180006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3933e8-d6c7-4c6d-a4c2-f442e1bcb4ee None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:57.189371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3933e8-d6c7-4c6d-a4c2-f442e1bcb4ee None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:57.194153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:57.194741 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.195014 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.195310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.195957 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:57.198079 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:57.228424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1428/2837] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:57 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:57.232593 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:57.243115 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173e184-e52c-4fa1-9f62-a64bf2a2cd1a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:57.294010 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:57.303097 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:57.303733 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.304009 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.304612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.305477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:57.307750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:57.331029 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1410/2838] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:57 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:08:57.335227 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:57.346471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02c920-ae7a-4e10-a4c5-b3b6b14f057e admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:57.351124 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:57.351715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.351990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.352255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.352887 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:57.354508 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:57.364387 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1429/2839] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:08:57.368339 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:57.382910 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310af2f2-fe34-4db2-affb-0a8c93cda9da admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:57.383184 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e6f92-fd8b-4e48-a24d-ec09c809aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:57.383781 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6f92-fd8b-4e48-a24d-ec09c809aa64 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.384056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6f92-fd8b-4e48-a24d-ec09c809aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.384331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e6f92-fd8b-4e48-a24d-ec09c809aa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.384969 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6f92-fd8b-4e48-a24d-ec09c809aa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:57.386587 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e6f92-fd8b-4e48-a24d-ec09c809aa64 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:57.402920 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1411/2840] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:57.404289 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:57.414869 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8c70-36b7-43a1-be4f-04812c9be423 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:57.419449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:57.420077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.420356 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.420629 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] PATH_INFO: `/v3/projects/ee877c09068c4b53b17446a79d615669/users/6f7c3b8084744633983cab85a7fc1a72/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.432806 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:57.436665 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee877c09068c4b53b17446a79d615669, user_id=6f7c3b8084744633983cab85a7fc1a72, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:57.440353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:57.455302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1430/2841] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:57 2022] PUT /identity/v3/projects/ee877c09068c4b53b17446a79d615669/users/6f7c3b8084744633983cab85a7fc1a72/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:57.460405 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc47be-c3d4-4a53-84ea-d9aba457b6d5 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.460868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc47be-c3d4-4a53-84ea-d9aba457b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.461206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc47be-c3d4-4a53-84ea-d9aba457b6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.480921 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-8abc47be-c3d4-4a53-84ea-d9aba457b6d5 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:57.482148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-8abc47be-c3d4-4a53-84ea-d9aba457b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:57.541647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1412/2842] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:57.552378 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:57.554277 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:57.612050 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe23b2f-4405-44c3-84f4-e7edc55e6deb admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:57.616264 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:57.616764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:57.617139 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:57.617301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:57.626880 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:57.628445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:57.637977 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1431/2843] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:08:58.297089 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229f0cb-c4a6-43ae-be66-2ac9cb321566 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:58.297576 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229f0cb-c4a6-43ae-be66-2ac9cb321566 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:58.297786 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229f0cb-c4a6-43ae-be66-2ac9cb321566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:58.329760 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3229f0cb-c4a6-43ae-be66-2ac9cb321566 None None] MFA Rules not processed for user `6f7c3b8084744633983cab85a7fc1a72`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:58.331046 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3229f0cb-c4a6-43ae-be66-2ac9cb321566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:58.410231 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1413/2844] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:58.415974 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:58.426959 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af667908-efc2-49d5-b809-e9e77fc0abd0 service neutron] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:58.431301 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:58.431975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:58.433060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:58.433335 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:58.433986 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:58.437042 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:58.470542 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1432/2845] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:08:58 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:58.474735 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229f0cb-c4a6-43ae-be66-2ac9cb321566 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:58.486604 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229f0cb-c4a6-43ae-be66-2ac9cb321566 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:58.545739 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:58.546399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:58.546682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:58.546963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:58.547695 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:58.549701 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:58.560899 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:58.574455 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1414/2846] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:08:58 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:08:58.578647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:58.589644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d487f7e-0abf-4451-877a-6533e144d531 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:58.594045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:58.594667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:58.594943 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:58.595214 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:58.596105 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:58.597705 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:58.610262 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1433/2847] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:58.612665 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:58.622590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61696d8a-97ef-4346-9d3c-6d4315a2a3f3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:58.627961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:58.628616 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:58.628897 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:58.629171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] PATH_INFO: `/v3/projects/a51bee55c49d4da98c2c2d2f9aa6f755/users/cc0fe000e71549a3b8be87a8cf34bc52/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:58.645868 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51bee55c49d4da98c2c2d2f9aa6f755, user_id=cc0fe000e71549a3b8be87a8cf34bc52, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:58.648628 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:58.661492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1415/2848] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:58 2022] PUT /identity/v3/projects/a51bee55c49d4da98c2c2d2f9aa6f755/users/cc0fe000e71549a3b8be87a8cf34bc52/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:08:58.665626 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:58.676712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d716a8-2f4e-4b95-adbe-48065bbacfcc admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:58.749218 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85119a44-0208-4fd3-8adc-22c76a0e52c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:58.749838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85119a44-0208-4fd3-8adc-22c76a0e52c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:58.750143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85119a44-0208-4fd3-8adc-22c76a0e52c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:58.750424 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85119a44-0208-4fd3-8adc-22c76a0e52c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:58.751070 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85119a44-0208-4fd3-8adc-22c76a0e52c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:58.753303 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85119a44-0208-4fd3-8adc-22c76a0e52c3 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:58.763743 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1434/2849] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:08:58.768030 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:58.778153 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471a81a-76df-4612-bae7-164fe60f338f admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:58.782771 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc1ed0-63d1-44a3-b3a9-a697a3f24d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:58.783540 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc1ed0-63d1-44a3-b3a9-a697a3f24d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:58.783817 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc1ed0-63d1-44a3-b3a9-a697a3f24d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:58.784086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc1ed0-63d1-44a3-b3a9-a697a3f24d2b admin admin] PATH_INFO: `/v3/projects/a51bee55c49d4da98c2c2d2f9aa6f755/users/cc0fe000e71549a3b8be87a8cf34bc52/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:58.786017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc1ed0-63d1-44a3-b3a9-a697a3f24d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51bee55c49d4da98c2c2d2f9aa6f755, user_id=cc0fe000e71549a3b8be87a8cf34bc52, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:58.789159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc1ed0-63d1-44a3-b3a9-a697a3f24d2b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:58.799941 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1416/2850] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:08:58 2022] PUT /identity/v3/projects/a51bee55c49d4da98c2c2d2f9aa6f755/users/cc0fe000e71549a3b8be87a8cf34bc52/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:08:59.492292 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0640-f64e-4486-bf68-10e6108516da None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:59.492937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0640-f64e-4486-bf68-10e6108516da None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:59.492937 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e0640-f64e-4486-bf68-10e6108516da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:59.522537 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-976e0640-f64e-4486-bf68-10e6108516da None None] MFA Rules not processed for user `cc0fe000e71549a3b8be87a8cf34bc52`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:59.523829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-976e0640-f64e-4486-bf68-10e6108516da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:59.570268 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:08:59.596511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1435/2851] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:59.606673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:59.607205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:59.607205 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:59.627870 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] MFA Rules not processed for user `6f7c3b8084744633983cab85a7fc1a72`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:08:59.629093 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:59.682429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1417/2852] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:08:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:08:59.695171 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0640-f64e-4486-bf68-10e6108516da None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:08:59.698644 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-976e0640-f64e-4486-bf68-10e6108516da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:08:59.771240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e0640-f64e-4486-bf68-10e6108516da None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:08:59.776676 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:08:59.777272 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:08:59.777549 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:08:59.777819 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:08:59.786184 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:08:59.787757 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:08:59.796621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1436/2853] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:08:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:02.339590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:02.341107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:02.398436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77fcac-7153-4457-9e9e-16686ff01421 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:02.402127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b33ad-9ebd-4fef-a0f6-65f5a13b67c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:02.402644 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b33ad-9ebd-4fef-a0f6-65f5a13b67c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:02.403056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b33ad-9ebd-4fef-a0f6-65f5a13b67c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:02.403273 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b33ad-9ebd-4fef-a0f6-65f5a13b67c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:02.405145 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a20b33ad-9ebd-4fef-a0f6-65f5a13b67c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:02.407012 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:02.409140 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:02.415638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b33ad-9ebd-4fef-a0f6-65f5a13b67c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:02.417076 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b33ad-9ebd-4fef-a0f6-65f5a13b67c1 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:02.426623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1418/2854] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:02.477255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331db36-24ad-4077-bdee-342c1c96d8fd service nova] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:02.481832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:02.482483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:02.482767 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:02.483043 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] PATH_INFO: `/v3/users/7abd9a1953f94860bac8e41360025f94` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:02.484161 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abd9a1953f94860bac8e41360025f94)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:02.486718 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:02.535689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abd9a1953f94860bac8e41360025f94'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:02.543772 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abd9a1953f94860bac8e41360025f94'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:02.559388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:02.561445 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abd9a1953f94860bac8e41360025f94'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:02.562415 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abd9a1953f94860bac8e41360025f94'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:02.574258 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abd9a1953f94860bac8e41360025f94'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:02.585871 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1437/2855] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:02 2022] DELETE /identity/v3/users/7abd9a1953f94860bac8e41360025f94 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 15:09:02.590237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee1a72-3752-438a-b145-f32df691975f None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:02.590568 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee1a72-3752-438a-b145-f32df691975f None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:02.590843 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee1a72-3752-438a-b145-f32df691975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:02.610125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-35ee1a72-3752-438a-b145-f32df691975f None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:02.612006 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-35ee1a72-3752-438a-b145-f32df691975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:02.676027 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1419/2856] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 15:09:02.686595 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:02.688371 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:02.748273 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11457260-00c4-4937-90ee-ec18d1d9a5d9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:02.753120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7e44c-b7b7-479a-9284-3a4ffa72c365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:02.753724 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e44c-b7b7-479a-9284-3a4ffa72c365 service neutron] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:02.753996 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e44c-b7b7-479a-9284-3a4ffa72c365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:02.754328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7e44c-b7b7-479a-9284-3a4ffa72c365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:02.763639 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e44c-b7b7-479a-9284-3a4ffa72c365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:02.765077 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7e44c-b7b7-479a-9284-3a4ffa72c365 service neutron] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:02.774801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1438/2857] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:03.056574 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee1a72-3752-438a-b145-f32df691975f None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.058293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-35ee1a72-3752-438a-b145-f32df691975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:03.067384 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:03.082730 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee1a72-3752-438a-b145-f32df691975f None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.088084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.088726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.089007 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.089297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] PATH_INFO: `/v3/projects/4c35a23168b44a07baf9cc69914609c8` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.090478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c35a23168b44a07baf9cc69914609c8)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.092353 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.141575 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c35a23168b44a07baf9cc69914609c8', 'request_id': 'req-c3110820-2f6c-4141-bdc1-098a4f2575f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:03.148750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c35a23168b44a07baf9cc69914609c8', 'request_id': 'req-c3110820-2f6c-4141-bdc1-098a4f2575f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:03.155315 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c35a23168b44a07baf9cc69914609c8', 'request_id': 'req-c3110820-2f6c-4141-bdc1-098a4f2575f3'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:03.168095 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] The token cache is being invalidate because project 4c35a23168b44a07baf9cc69914609c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81511) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:03.169683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:03.169683 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:03.170488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1420/2858] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:03 2022] DELETE /identity/v3/projects/4c35a23168b44a07baf9cc69914609c8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:03.176007 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9082b7c-b950-4929-bddf-f96fd2a28aad None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.176141 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9082b7c-b950-4929-bddf-f96fd2a28aad None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.176405 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9082b7c-b950-4929-bddf-f96fd2a28aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.191327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.193391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:03.199939 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-d9082b7c-b950-4929-bddf-f96fd2a28aad None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:03.201182 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-d9082b7c-b950-4929-bddf-f96fd2a28aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:03.277996 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3110820-2f6c-4141-bdc1-098a4f2575f3 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.284452 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8908c33eb701459298d35fa8ccb80bd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.285602 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.285734 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1439/2859] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:03.285864 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.286174 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.288442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:03.293192 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b54f0-d4ea-496d-86cc-5de2eec854ff None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.293483 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b54f0-d4ea-496d-86cc-5de2eec854ff None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.293754 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b54f0-d4ea-496d-86cc-5de2eec854ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.302032 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.303703 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.313972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-c05b54f0-d4ea-496d-86cc-5de2eec854ff None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:03.316009 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c05b54f0-d4ea-496d-86cc-5de2eec854ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:03.316252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1421/2860] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:03.327464 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1440/2861] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:03.331785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.342839 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9e6c8-116d-470a-a1e4-d482ae9e5637 service nova] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.347956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.348620 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.348980 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.349317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.349963 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:09:03.350300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.351903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.364698 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1422/2862] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 15:09:03.368954 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b54f0-d4ea-496d-86cc-5de2eec854ff None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.379120 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b54f0-d4ea-496d-86cc-5de2eec854ff None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.385078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.385877 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.386327 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.386727 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.387612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.389529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.420975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1441/2863] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:09:03 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:09:03.426107 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.443704 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e1ced-76b2-4a1e-86eb-fd4057f250c8 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.502700 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.503662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.503662 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.503882 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.504515 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.506873 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.515240 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:03.530779 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1423/2864] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:09:03 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 15:09:03.534155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.544430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18b3ae-d064-4e56-a915-1e5bee0aa90c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.549683 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.550099 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.550382 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.550648 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.551350 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.552927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.563113 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1442/2865] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 15:09:03.567867 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.578105 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbe9a6-f6cf-4b1b-b207-7252911bc7ba admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.582947 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f016d3-b669-4fe6-ab00-699b51167a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.583541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f016d3-b669-4fe6-ab00-699b51167a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.583816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f016d3-b669-4fe6-ab00-699b51167a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.584084 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f016d3-b669-4fe6-ab00-699b51167a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.584716 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f016d3-b669-4fe6-ab00-699b51167a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.586325 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f016d3-b669-4fe6-ab00-699b51167a53 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.600967 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1424/2866] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:03.602255 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.612824 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c42ee-cece-49a8-bdd9-82f85a50c3f0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.617441 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.618081 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.618388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.618659 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] PATH_INFO: `/v3/projects/dbaf07f05b3d4905ad42dfbb1b5e3f49/users/bbbabccdac8e457c9837cf175d9da975/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.634068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaf07f05b3d4905ad42dfbb1b5e3f49, user_id=bbbabccdac8e457c9837cf175d9da975, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.636885 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.650019 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1443/2867] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:09:03 2022] PUT /identity/v3/projects/dbaf07f05b3d4905ad42dfbb1b5e3f49/users/bbbabccdac8e457c9837cf175d9da975/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:03.660797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f755-be3f-4fb7-a019-b4ac40286b11 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.661086 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f755-be3f-4fb7-a019-b4ac40286b11 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.661362 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f755-be3f-4fb7-a019-b4ac40286b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.690355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-e905f755-be3f-4fb7-a019-b4ac40286b11 None None] MFA Rules not processed for user `bbbabccdac8e457c9837cf175d9da975`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:03.691478 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e905f755-be3f-4fb7-a019-b4ac40286b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:03.755056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1425/2868] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:03.765569 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:03.767403 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:03.797812 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:03.827116 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468192e4-8003-4dc2-ab11-2018722666d9 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:03.830968 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:03.831571 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:03.831852 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:03.832145 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:03.840688 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:03.842136 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:03.851738 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1444/2869] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:05.273180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5a01-43bd-43e7-aaf5-4f80af5539a6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:05.273734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5a01-43bd-43e7-aaf5-4f80af5539a6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:05.273734 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c5a01-43bd-43e7-aaf5-4f80af5539a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:05.293488 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-818c5a01-43bd-43e7-aaf5-4f80af5539a6 None None] MFA Rules not processed for user `bbbabccdac8e457c9837cf175d9da975`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:05.294696 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-818c5a01-43bd-43e7-aaf5-4f80af5539a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:05.302475 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1426/2870] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:13.847708 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=14 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:15.237321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:15.238808 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:15.249872 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a156-6e80-4e04-ab38-7b0187936a6d service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:15.253486 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:15.254071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:15.254376 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:15.254647 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:15.256281 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:15.287933 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:INSERT=3,keystone:SELECT=42 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:15.319898 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:15.321332 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:15.331111 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1445/2871] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:21.780775 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43342-2ff9-4495-ad67-6883bdd58105 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:21.781262 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43342-2ff9-4495-ad67-6883bdd58105 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:21.781361 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f43342-2ff9-4495-ad67-6883bdd58105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:21.830874 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-03f43342-2ff9-4495-ad67-6883bdd58105 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:21.832073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-03f43342-2ff9-4495-ad67-6883bdd58105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:21.895252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1427/2872] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:09:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:21.941285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:21.942712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:22.035614 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20907cc3-35e6-4029-8e19-edb994a59d33 service cinder] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:22.041086 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:22.041764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:22.042135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:22.043457 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:22.056260 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:22.057975 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:22.067678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1446/2873] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:09:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:09:22.606525 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ec57-52bd-491f-b5af-97c9622b0fe6 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:22.606814 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ec57-52bd-491f-b5af-97c9622b0fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:22.607094 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ec57-52bd-491f-b5af-97c9622b0fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:22.625984 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0971ec57-52bd-491f-b5af-97c9622b0fe6 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:22.628442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0971ec57-52bd-491f-b5af-97c9622b0fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:22.636638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1428/2874] 10.222.0.52 () {58 vars in 967 bytes} [Fri Sep 9 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:22.649555 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:22.660068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eb3e7-449a-4db1-bb7a-854065bdd9ce service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:22.665068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:22.665653 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:22.665927 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:22.666230 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:22.675035 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:22.676590 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:22.684506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1447/2875] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:09:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:09:22.912057 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded78ed-a5de-41d9-99e6-bd5f2797e629 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:22.912527 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded78ed-a5de-41d9-99e6-bd5f2797e629 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:22.912623 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded78ed-a5de-41d9-99e6-bd5f2797e629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:22.932257 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-dded78ed-a5de-41d9-99e6-bd5f2797e629 None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:22.933439 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-dded78ed-a5de-41d9-99e6-bd5f2797e629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:22.942180 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1429/2876] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Sep 9 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:22.954112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:22.964745 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca2e6b-0e95-48d7-879f-3d4e2d091f2c service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:22.970506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:22.971169 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:22.971447 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:22.971715 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:22.979790 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:22.981337 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:22.990176 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1448/2877] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:09:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:09:23.312785 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bedf-5ab2-4d20-b880-32c9caaa246b None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:23.313062 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bedf-5ab2-4d20-b880-32c9caaa246b None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:23.313332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50bedf-5ab2-4d20-b880-32c9caaa246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:23.333190 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3c50bedf-5ab2-4d20-b880-32c9caaa246b None None] MFA Rules not processed for user `4dbfce81ff9a43bcbb783a19819ad4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:23.334396 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3c50bedf-5ab2-4d20-b880-32c9caaa246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:23.341565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1430/2878] 10.222.0.52 () {58 vars in 967 bytes} [Fri Sep 9 15:09:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:23.354199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:23.365397 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5de33b-e457-4189-bebe-1764aeff7bee service swift] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:23.372193 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9119e6-0980-4f35-9f99-23bd3015aa60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7d4404bc9fb4bae8e8114daecd6409a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:23.372801 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9119e6-0980-4f35-9f99-23bd3015aa60 service swift] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:23.373078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9119e6-0980-4f35-9f99-23bd3015aa60 service swift] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:23.373361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9119e6-0980-4f35-9f99-23bd3015aa60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:23.381952 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9119e6-0980-4f35-9f99-23bd3015aa60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:23.383546 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9119e6-0980-4f35-9f99-23bd3015aa60 service swift] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:23.391707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1449/2879] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Sep 9 15:09:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 15:09:25.507042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50bedf-5ab2-4d20-b880-32c9caaa246b None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:25.568750 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50bedf-5ab2-4d20-b880-32c9caaa246b None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:25.573466 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:25.574101 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:25.574389 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:25.574661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] PATH_INFO: `/v3/users/bbbabccdac8e457c9837cf175d9da975` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:25.575816 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbabccdac8e457c9837cf175d9da975)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:25.577713 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:25.622108 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbabccdac8e457c9837cf175d9da975'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:25.629431 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbabccdac8e457c9837cf175d9da975'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:25.630120 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbabccdac8e457c9837cf175d9da975'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:25.631336 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:25.639689 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbabccdac8e457c9837cf175d9da975'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:25.651611 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbabccdac8e457c9837cf175d9da975'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:25.657577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1431/2880] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:25 2022] DELETE /identity/v3/users/bbbabccdac8e457c9837cf175d9da975 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:25.662621 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:25.663094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:25.663302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:25.682496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:25.683739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:25.702349 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=100 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:25.744217 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1450/2881] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:25.754424 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:25.755797 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:25.813854 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a31673-38a2-4d6f-ba89-d0f1921133b4 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:25.818379 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:25.818978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:25.819252 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:25.819521 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:25.828645 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:25.830067 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:25.839355 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1432/2882] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:26.010002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:26.011699 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:26.024442 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faa13b-3666-4b1c-bc91-74cfef6fc9d6 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:26.029317 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:26.029928 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:26.030204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:26.030399 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] PATH_INFO: `/v3/projects/dbaf07f05b3d4905ad42dfbb1b5e3f49` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:26.031706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbaf07f05b3d4905ad42dfbb1b5e3f49)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:26.034117 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:26.089160 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbaf07f05b3d4905ad42dfbb1b5e3f49', 'request_id': 'req-8f75f296-3ba3-45d4-9872-244c882b721f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:26.094660 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbaf07f05b3d4905ad42dfbb1b5e3f49', 'request_id': 'req-8f75f296-3ba3-45d4-9872-244c882b721f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:26.100809 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbaf07f05b3d4905ad42dfbb1b5e3f49', 'request_id': 'req-8f75f296-3ba3-45d4-9872-244c882b721f'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:26.115568 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] The token cache is being invalidate because project dbaf07f05b3d4905ad42dfbb1b5e3f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:26.115864 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:26.116617 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:26.118152 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1451/2883] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:26 2022] DELETE /identity/v3/projects/dbaf07f05b3d4905ad42dfbb1b5e3f49 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:35.835209 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=37,keystone:DELETE=2 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:36.112321 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:36.293978 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:36.295450 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:36.311590 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e528f-0cec-4d20-9778-8751969c8bf8 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:36.369229 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:36.369770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:36.370053 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:36.370354 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] PATH_INFO: `/v3/users/6f7c3b8084744633983cab85a7fc1a72` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:36.371502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7c3b8084744633983cab85a7fc1a72)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:36.373409 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:36.418541 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7c3b8084744633983cab85a7fc1a72'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.427176 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7c3b8084744633983cab85a7fc1a72'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.427819 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7c3b8084744633983cab85a7fc1a72'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.434711 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7c3b8084744633983cab85a7fc1a72'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.447567 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7c3b8084744633983cab85a7fc1a72'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.453618 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1433/2884] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:36 2022] DELETE /identity/v3/users/6f7c3b8084744633983cab85a7fc1a72 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:36.627312 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:36.628876 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:36.643515 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f296-3ba3-45d4-9872-244c882b721f admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:36.702155 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:36.702814 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:36.703094 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:36.703366 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] PATH_INFO: `/v3/projects/ee877c09068c4b53b17446a79d615669` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:36.704478 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee877c09068c4b53b17446a79d615669)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:36.706523 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:36.755293 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee877c09068c4b53b17446a79d615669', 'request_id': 'req-c868caa5-f932-4f3f-aa05-8faf35237527'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.760693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee877c09068c4b53b17446a79d615669', 'request_id': 'req-c868caa5-f932-4f3f-aa05-8faf35237527'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.766643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee877c09068c4b53b17446a79d615669', 'request_id': 'req-c868caa5-f932-4f3f-aa05-8faf35237527'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.778902 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] The token cache is being invalidate because project ee877c09068c4b53b17446a79d615669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:36.779209 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.779856 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.781325 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1452/2885] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:36 2022] DELETE /identity/v3/projects/ee877c09068c4b53b17446a79d615669 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:36.785838 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:36.787281 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:36.800388 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33d567-9299-4593-adfe-9e304e4d0e4e admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:36.855302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:36.855949 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:36.856181 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:36.856448 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] PATH_INFO: `/v3/users/cc0fe000e71549a3b8be87a8cf34bc52` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:36.857544 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0fe000e71549a3b8be87a8cf34bc52)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:36.860476 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:36.883274 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:36.909333 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0fe000e71549a3b8be87a8cf34bc52'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.916676 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0fe000e71549a3b8be87a8cf34bc52'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.917291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0fe000e71549a3b8be87a8cf34bc52'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.925323 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0fe000e71549a3b8be87a8cf34bc52'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.937612 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-ad72be92-091c-4027-947b-48ea0bf0f1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0fe000e71549a3b8be87a8cf34bc52'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:36.943660 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1434/2886] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:36 2022] DELETE /identity/v3/users/cc0fe000e71549a3b8be87a8cf34bc52 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:37.114635 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.116056 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:37.129284 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868caa5-f932-4f3f-aa05-8faf35237527 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.187696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.188308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.188587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.188859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] PATH_INFO: `/v3/projects/a51bee55c49d4da98c2c2d2f9aa6f755` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.189967 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51bee55c49d4da98c2c2d2f9aa6f755)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.191890 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.226389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:37.239620 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51bee55c49d4da98c2c2d2f9aa6f755', 'request_id': 'req-0e506d2a-456e-413f-940e-6567f8781bc6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:37.245114 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51bee55c49d4da98c2c2d2f9aa6f755', 'request_id': 'req-0e506d2a-456e-413f-940e-6567f8781bc6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:37.251142 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51bee55c49d4da98c2c2d2f9aa6f755', 'request_id': 'req-0e506d2a-456e-413f-940e-6567f8781bc6'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:37.263091 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] The token cache is being invalidate because project a51bee55c49d4da98c2c2d2f9aa6f755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:37.263377 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:37.263985 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-0e506d2a-456e-413f-940e-6567f8781bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:37.265433 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1453/2887] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:37 2022] DELETE /identity/v3/projects/a51bee55c49d4da98c2c2d2f9aa6f755 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:37.271203 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26079e1-4675-47fa-ae35-3e65e960d2ad None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.271566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26079e1-4675-47fa-ae35-3e65e960d2ad None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.271850 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26079e1-4675-47fa-ae35-3e65e960d2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.292484 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-a26079e1-4675-47fa-ae35-3e65e960d2ad None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:37.293682 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-a26079e1-4675-47fa-ae35-3e65e960d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:37.351371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1435/2888] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:37.359018 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25eee-480c-41b4-9bda-417118e118cd None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.359302 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25eee-480c-41b4-9bda-417118e118cd None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.359575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b25eee-480c-41b4-9bda-417118e118cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.379285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-a4b25eee-480c-41b4-9bda-417118e118cd None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:37.380476 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a4b25eee-480c-41b4-9bda-417118e118cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:37.388563 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1454/2889] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:37.392743 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26079e1-4675-47fa-ae35-3e65e960d2ad None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.402831 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26079e1-4675-47fa-ae35-3e65e960d2ad None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.407383 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.407977 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.408282 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.408668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.409291 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:09:37.409595 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.411223 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.422430 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1436/2890] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:09:37.426782 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b25eee-480c-41b4-9bda-417118e118cd None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.435843 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b25eee-480c-41b4-9bda-417118e118cd None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.441064 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.441650 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.441930 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.442237 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.442874 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.444751 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.472353 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1455/2891] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:09:37 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:37.476708 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.486770 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a394591-d73c-449c-8b21-f58abb6a7b9b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.545637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.546302 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.546569 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.546840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.547477 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.549407 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.571460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1437/2892] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:09:37 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:37.576060 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.587323 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2a40-4ac2-489e-a846-43bb8e87dca4 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.591933 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.592547 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.592827 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.593098 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.593725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.595344 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.605083 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1456/2893] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:37.608970 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.618916 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aa8b2-8e4d-43c2-8e64-4b98298131d7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.623510 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184ac86-aad0-4733-b67d-dd472ab06b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.624099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ac86-aad0-4733-b67d-dd472ab06b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.624378 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ac86-aad0-4733-b67d-dd472ab06b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.624647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184ac86-aad0-4733-b67d-dd472ab06b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.625278 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184ac86-aad0-4733-b67d-dd472ab06b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.626890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184ac86-aad0-4733-b67d-dd472ab06b0a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.637738 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1438/2894] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:37.641878 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.652559 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3d058-1856-4dd8-8bbc-2a370b253830 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.657150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.657783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.658062 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.658393 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] PATH_INFO: `/v3/projects/30b564b6377e456cb143468f541b624d/users/9a2d6bb39b9146b0a0617df61beafc20/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.672519 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b564b6377e456cb143468f541b624d, user_id=9a2d6bb39b9146b0a0617df61beafc20, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.675682 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.688612 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1457/2895] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:09:37 2022] PUT /identity/v3/projects/30b564b6377e456cb143468f541b624d/users/9a2d6bb39b9146b0a0617df61beafc20/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:37.699565 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69644-df6d-416b-ae4a-b05ecd08d1ed None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.699869 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69644-df6d-416b-ae4a-b05ecd08d1ed None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.700125 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69644-df6d-416b-ae4a-b05ecd08d1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.708256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:37.728127 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-d3b69644-df6d-416b-ae4a-b05ecd08d1ed None None] MFA Rules not processed for user `9a2d6bb39b9146b0a0617df61beafc20`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:37.729316 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-d3b69644-df6d-416b-ae4a-b05ecd08d1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:37.793207 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1439/2896] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:37.797787 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.859613 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46907a84-6d28-48ec-8547-1e6c62eca2c0 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.865004 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.865587 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.865861 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.866150 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.866773 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.868655 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.895374 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1458/2897] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:09:37 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:37.899429 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b69644-df6d-416b-ae4a-b05ecd08d1ed None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:37.910663 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b69644-df6d-416b-ae4a-b05ecd08d1ed None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:37.966453 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:37.967054 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:37.967363 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:37.967637 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:37.968256 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:37.970177 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:37.992331 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1440/2898] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:09:37 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:37.996267 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:38.007025 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe677ea4-ec76-4741-94a1-7067d082dc57 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:38.011619 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:38.012204 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:38.012482 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:38.012758 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:38.013388 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:38.015001 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:38.025285 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1459/2899] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:38.029308 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:38.039726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdb6d4-9b44-463f-9240-b06dccf1042b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:38.044294 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:38.044935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:38.045214 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:38.045485 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] PATH_INFO: `/v3/projects/e85c88d9d29a4cda977c19cb5b253698/users/40df6a3b3c2e43bf90b80b10ec4b33ef/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:38.060563 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c88d9d29a4cda977c19cb5b253698, user_id=40df6a3b3c2e43bf90b80b10ec4b33ef, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:38.063228 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:38.076092 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1441/2900] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:09:38 2022] PUT /identity/v3/projects/e85c88d9d29a4cda977c19cb5b253698/users/40df6a3b3c2e43bf90b80b10ec4b33ef/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:38.080063 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:38.089832 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace4f0-4fc1-4427-b753-ab4fabddbc23 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:38.121840 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:38.150646 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd9965-a5af-45c0-a64e-02813864a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:38.151172 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9965-a5af-45c0-a64e-02813864a35b admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:38.151470 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9965-a5af-45c0-a64e-02813864a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:38.151739 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9965-a5af-45c0-a64e-02813864a35b admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:38.152365 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd9965-a5af-45c0-a64e-02813864a35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:38.153972 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd9965-a5af-45c0-a64e-02813864a35b admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:38.164336 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1460/2901] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:38.168549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:38.179545 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f381ac9-d4df-4c4a-9b6c-66e289d0e3a7 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:38.185185 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:38.185856 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:38.186162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:38.186433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] PATH_INFO: `/v3/projects/e85c88d9d29a4cda977c19cb5b253698/users/40df6a3b3c2e43bf90b80b10ec4b33ef/roles/129e9ce3dddb438da251c372b5c90f63` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:38.188398 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85c88d9d29a4cda977c19cb5b253698, user_id=40df6a3b3c2e43bf90b80b10ec4b33ef, role_id=129e9ce3dddb438da251c372b5c90f63)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:38.191415 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:38.201680 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1442/2902] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:09:38 2022] PUT /identity/v3/projects/e85c88d9d29a4cda977c19cb5b253698/users/40df6a3b3c2e43bf90b80b10ec4b33ef/roles/129e9ce3dddb438da251c372b5c90f63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:38.213313 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:38.213597 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:38.213867 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:38.243180 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] MFA Rules not processed for user `40df6a3b3c2e43bf90b80b10ec4b33ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:38.244414 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:38.310764 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1461/2903] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:38.321559 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:38.323319 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:38.375146 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:38.381124 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d0a3d-8b7b-4361-abba-791e3e22c072 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:38.385073 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:38.385668 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:38.385945 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:38.386246 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:38.441617 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:38.442997 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:38.452099 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1443/2904] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:42.685420 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:42.690410 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:42.703311 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a971f4-ca33-4e7d-8fb9-eb4f229b03a9 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:42.708027 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b7cf-cf13-44b5-9b04-a22922297a56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:42.708995 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b7cf-cf13-44b5-9b04-a22922297a56 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:42.709430 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b7cf-cf13-44b5-9b04-a22922297a56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:42.709709 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b7cf-cf13-44b5-9b04-a22922297a56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:42.720045 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b7cf-cf13-44b5-9b04-a22922297a56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:42.722982 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b7cf-cf13-44b5-9b04-a22922297a56 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:42.736849 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1462/2905] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:47.662840 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:47.726238 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fee4a1-f6fc-41d0-9ede-95a64bf61fca service cinder] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:47.730678 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:47.731300 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:47.731577 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:47.731849 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] PATH_INFO: `/v3/users/9a2d6bb39b9146b0a0617df61beafc20` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:47.732956 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2d6bb39b9146b0a0617df61beafc20)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:47.734961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:47.781161 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2d6bb39b9146b0a0617df61beafc20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:47.788293 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2d6bb39b9146b0a0617df61beafc20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:47.788961 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2d6bb39b9146b0a0617df61beafc20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:47.795896 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2d6bb39b9146b0a0617df61beafc20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:47.808017 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2d6bb39b9146b0a0617df61beafc20'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:47.813763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1444/2906] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:47 2022] DELETE /identity/v3/users/9a2d6bb39b9146b0a0617df61beafc20 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:47.819183 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:47.819667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:47.819769 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:47.838499 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:47.839689 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:47.897088 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1463/2907] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:47.907040 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:47.908454 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:47.930833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:47.967373 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfca5a8-fa52-4072-a7dc-2889ffc13d81 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:47.970962 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:47.971556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:47.971829 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:47.972267 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:47.981208 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:47.982659 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:47.992822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1445/2908] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:48.257892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:48.259351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:48.271889 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddbc62-3e64-4a9d-8ca5-750eea677a28 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:48.276921 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:48.277552 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:48.277829 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:48.278112 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] PATH_INFO: `/v3/projects/30b564b6377e456cb143468f541b624d` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:48.279240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b564b6377e456cb143468f541b624d)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:48.281210 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:48.318980 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:48.329838 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b564b6377e456cb143468f541b624d', 'request_id': 'req-f2063a1e-5588-4be7-8685-9447eb299b66'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.335606 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b564b6377e456cb143468f541b624d', 'request_id': 'req-f2063a1e-5588-4be7-8685-9447eb299b66'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.342127 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b564b6377e456cb143468f541b624d', 'request_id': 'req-f2063a1e-5588-4be7-8685-9447eb299b66'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.355449 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] The token cache is being invalidate because project 30b564b6377e456cb143468f541b624d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:48.355736 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.356352 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.357828 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1464/2909] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:48 2022] DELETE /identity/v3/projects/30b564b6377e456cb143468f541b624d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:48.361929 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:48.372023 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08503ab-ef12-4ce1-a397-da51c328acd9 service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:48.427890 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:48.428508 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:48.428784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:48.429050 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] PATH_INFO: `/v3/users/40df6a3b3c2e43bf90b80b10ec4b33ef` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:48.430162 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] RBAC: Authorizing `identity:delete_user(user_id=40df6a3b3c2e43bf90b80b10ec4b33ef)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:48.432052 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:48.476365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40df6a3b3c2e43bf90b80b10ec4b33ef'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.483064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40df6a3b3c2e43bf90b80b10ec4b33ef'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.483656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40df6a3b3c2e43bf90b80b10ec4b33ef'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.491442 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40df6a3b3c2e43bf90b80b10ec4b33ef'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.502754 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-1fa0c6f5-b904-4cef-8989-759288fc727b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40df6a3b3c2e43bf90b80b10ec4b33ef'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.508755 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1446/2910] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:48 2022] DELETE /identity/v3/users/40df6a3b3c2e43bf90b80b10ec4b33ef => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:48.778174 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:48.779580 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:48.792963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2063a1e-5588-4be7-8685-9447eb299b66 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:48.849842 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:48.850538 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:48.850761 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:48.851029 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] PATH_INFO: `/v3/projects/e85c88d9d29a4cda977c19cb5b253698` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:48.852153 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85c88d9d29a4cda977c19cb5b253698)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:48.854151 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:48.900021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85c88d9d29a4cda977c19cb5b253698', 'request_id': 'req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.905654 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85c88d9d29a4cda977c19cb5b253698', 'request_id': 'req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.912294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85c88d9d29a4cda977c19cb5b253698', 'request_id': 'req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.924879 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] The token cache is being invalidate because project e85c88d9d29a4cda977c19cb5b253698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:48.925904 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.926577 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-03df5c5d-ac3e-4846-9b92-2752d1f89f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:48.928075 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1465/2911] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:48 2022] DELETE /identity/v3/projects/e85c88d9d29a4cda977c19cb5b253698 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:48.933905 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10420769-fa47-49df-a189-a2dc0cece086 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:48.934391 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10420769-fa47-49df-a189-a2dc0cece086 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:48.934503 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10420769-fa47-49df-a189-a2dc0cece086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:48.955045 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-10420769-fa47-49df-a189-a2dc0cece086 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:48.956249 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-10420769-fa47-49df-a189-a2dc0cece086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:48.994638 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:49.017433 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1447/2912] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:49.026162 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a0959-63d9-46fc-a636-f762fb7bbd06 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.026452 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a0959-63d9-46fc-a636-f762fb7bbd06 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.026730 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a0959-63d9-46fc-a636-f762fb7bbd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.046796 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-102a0959-63d9-46fc-a636-f762fb7bbd06 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:49.048002 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-102a0959-63d9-46fc-a636-f762fb7bbd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:49.056556 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1466/2913] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:49.060801 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10420769-fa47-49df-a189-a2dc0cece086 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:49.070737 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10420769-fa47-49df-a189-a2dc0cece086 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:49.075566 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:49.076157 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.076436 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.076709 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.077347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:09:49.077649 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:49.079286 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:49.090647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1448/2914] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:09:49.094817 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a0959-63d9-46fc-a636-f762fb7bbd06 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:49.104722 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a0959-63d9-46fc-a636-f762fb7bbd06 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:49.109489 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:49.110135 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.110422 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.110695 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.111328 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:49.113859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:49.140324 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1467/2915] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:09:49 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:49.144356 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:49.154271 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c41fb-b7c1-4191-8665-8bceea64ebd2 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:49.211165 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:49.211763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.212042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.212317 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.212950 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:49.214881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:49.236159 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1449/2916] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:09:49 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:49.240923 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:49.250963 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ed007-ad3f-49a5-b9bd-2cdffcb19491 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:49.255622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:49.256206 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.256481 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.256747 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.257369 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:49.258955 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:49.269678 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1468/2917] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:49.273554 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:49.283502 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2232d-ae25-49d4-b485-70a6ce60db4b admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:49.288332 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a4f1-f11e-496a-9396-cc2ebe385674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:49.288919 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a4f1-f11e-496a-9396-cc2ebe385674 admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.289200 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a4f1-f11e-496a-9396-cc2ebe385674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.289474 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a4f1-f11e-496a-9396-cc2ebe385674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.290129 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77a4f1-f11e-496a-9396-cc2ebe385674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:49.291723 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77a4f1-f11e-496a-9396-cc2ebe385674 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:49.303031 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1450/2918] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:49.306909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:49.318103 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deb4f7-354b-4c19-835a-aae9dc7e6843 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:49.322859 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:49.323498 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.324033 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.324308 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] PATH_INFO: `/v3/projects/eb018755b2d64c1dbc20accf495d1123/users/5aa80eba783e4ca9ab1e7c393b7eac8e/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.335496 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:49.340201 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb018755b2d64c1dbc20accf495d1123, user_id=5aa80eba783e4ca9ab1e7c393b7eac8e, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:49.343006 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:49.356021 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1469/2919] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:09:49 2022] PUT /identity/v3/projects/eb018755b2d64c1dbc20accf495d1123/users/5aa80eba783e4ca9ab1e7c393b7eac8e/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:49.367647 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc551af-16f0-4366-8169-5f4322822d44 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.367928 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc551af-16f0-4366-8169-5f4322822d44 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.368226 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc551af-16f0-4366-8169-5f4322822d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.395710 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-3cc551af-16f0-4366-8169-5f4322822d44 None None] MFA Rules not processed for user `5aa80eba783e4ca9ab1e7c393b7eac8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:49.396903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-3cc551af-16f0-4366-8169-5f4322822d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:49.458960 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1451/2920] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:49.470783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:49.472525 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:49.528696 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f59b34-8c99-4c2e-b3ba-2731804ca995 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:49.532279 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54937e88-b499-4fe5-a4b7-2667996651f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:49.532865 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937e88-b499-4fe5-a4b7-2667996651f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:49.533137 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937e88-b499-4fe5-a4b7-2667996651f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:49.533401 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54937e88-b499-4fe5-a4b7-2667996651f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:49.541622 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937e88-b499-4fe5-a4b7-2667996651f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:49.543068 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54937e88-b499-4fe5-a4b7-2667996651f5 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:49.552472 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1470/2921] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:52.558517 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc551af-16f0-4366-8169-5f4322822d44 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:52.599881 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:52.621082 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc551af-16f0-4366-8169-5f4322822d44 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:52.625537 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:52.626179 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:52.626460 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:52.626726 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] PATH_INFO: `/v3/users/5aa80eba783e4ca9ab1e7c393b7eac8e` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:52.627822 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa80eba783e4ca9ab1e7c393b7eac8e)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:52.630297 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:52.678492 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa80eba783e4ca9ab1e7c393b7eac8e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:52.685528 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa80eba783e4ca9ab1e7c393b7eac8e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:52.686242 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa80eba783e4ca9ab1e7c393b7eac8e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:52.694080 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa80eba783e4ca9ab1e7c393b7eac8e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:52.706656 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa80eba783e4ca9ab1e7c393b7eac8e'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:52.712633 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1452/2922] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:52 2022] DELETE /identity/v3/users/5aa80eba783e4ca9ab1e7c393b7eac8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:52.717078 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:52.717527 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:52.717640 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:52.736693 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:52.737882 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:52.797168 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1471/2923] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:52.807655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:52.809037 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:52.865440 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3aa8a-3233-44b6-8d13-4496581a24e5 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:52.869064 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f271b-2f0c-470c-ba87-2dcb7bffaf99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:52.869661 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f271b-2f0c-470c-ba87-2dcb7bffaf99 service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:52.869938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f271b-2f0c-470c-ba87-2dcb7bffaf99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:52.870245 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f271b-2f0c-470c-ba87-2dcb7bffaf99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:52.879110 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f271b-2f0c-470c-ba87-2dcb7bffaf99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:52.880553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f271b-2f0c-470c-ba87-2dcb7bffaf99 service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:52.889812 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1453/2924] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:53.159802 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.161984 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:53.174340 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e378dca-0e3d-4f03-a834-f8bcea013c6c None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.180052 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.180851 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.181240 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.181663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] PATH_INFO: `/v3/projects/eb018755b2d64c1dbc20accf495d1123` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.182990 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb018755b2d64c1dbc20accf495d1123)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.185177 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.232466 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb018755b2d64c1dbc20accf495d1123', 'request_id': 'req-8c36aa28-caea-4727-9ca6-2013240d628c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:53.237862 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb018755b2d64c1dbc20accf495d1123', 'request_id': 'req-8c36aa28-caea-4727-9ca6-2013240d628c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:53.244607 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb018755b2d64c1dbc20accf495d1123', 'request_id': 'req-8c36aa28-caea-4727-9ca6-2013240d628c'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:53.257238 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] The token cache is being invalidate because project eb018755b2d64c1dbc20accf495d1123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:53.257506 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:53.258157 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-8c36aa28-caea-4727-9ca6-2013240d628c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:53.259618 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1472/2925] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:53 2022] DELETE /identity/v3/projects/eb018755b2d64c1dbc20accf495d1123 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:53.264624 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24160b-c377-4f7e-82c6-10a48a96e21d None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.264903 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24160b-c377-4f7e-82c6-10a48a96e21d None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.265172 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24160b-c377-4f7e-82c6-10a48a96e21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.284276 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-0a24160b-c377-4f7e-82c6-10a48a96e21d None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:53.285464 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-0a24160b-c377-4f7e-82c6-10a48a96e21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:53.335808 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:53.345493 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1454/2926] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:53.353392 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e24720-ad01-4f9f-8b4e-f4f774009eca None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.353690 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e24720-ad01-4f9f-8b4e-f4f774009eca None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.353951 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e24720-ad01-4f9f-8b4e-f4f774009eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.373783 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-99e24720-ad01-4f9f-8b4e-f4f774009eca None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:53.375020 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-99e24720-ad01-4f9f-8b4e-f4f774009eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:53.383712 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1473/2927] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:53.387999 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24160b-c377-4f7e-82c6-10a48a96e21d None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.398020 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24160b-c377-4f7e-82c6-10a48a96e21d None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.402634 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.403216 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.403495 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.403764 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.404399 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81511) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 15:09:53.404697 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.406312 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.418365 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1455/2928] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Sep 9 15:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 15:09:53.422674 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e24720-ad01-4f9f-8b4e-f4f774009eca None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.433008 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e24720-ad01-4f9f-8b4e-f4f774009eca None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.437663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.438294 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.438572 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.438844 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] PATH_INFO: `/v3/projects` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.439477 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.441351 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.446725 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:53.470071 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1474/2929] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Sep 9 15:09:53 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:53.474334 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.484549 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01c34-e399-4e58-887a-d8d8faf96edf admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.540605 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.541210 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.541490 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.541763 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] PATH_INFO: `/v3/users` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.542443 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.544347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.565725 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1456/2930] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Sep 9 15:09:53 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 15:09:53.570528 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.581132 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3d33a-7da0-4ead-8264-1306b601928c admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.585771 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.586439 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.586667 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.586938 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.587575 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.589179 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.598981 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1475/2931] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:53.603526 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.613347 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d4ade-7307-4f89-97be-7d304c77a54a admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.618670 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952473ee-0b6d-4b00-b429-c8c993d9eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.619255 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952473ee-0b6d-4b00-b429-c8c993d9eb1d admin admin] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.619534 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952473ee-0b6d-4b00-b429-c8c993d9eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.619832 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952473ee-0b6d-4b00-b429-c8c993d9eb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.620498 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952473ee-0b6d-4b00-b429-c8c993d9eb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.622056 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952473ee-0b6d-4b00-b429-c8c993d9eb1d admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.632729 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1457/2932] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Sep 9 15:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 15:09:53.636633 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.646529 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e77f2-bd87-41c7-8cca-7bffd0eed6aa admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.651471 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.652109 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.652389 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.652663 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] PATH_INFO: `/v3/projects/91282698e11b40368d7336d24f407fb3/users/492763f9e33540468d31c12e90604761/roles/b60e4f6e616d4b0bb7f4522d885667be` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.667714 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91282698e11b40368d7336d24f407fb3, user_id=492763f9e33540468d31c12e90604761, role_id=b60e4f6e616d4b0bb7f4522d885667be)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.670372 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.683700 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1476/2933] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Sep 9 15:09:53 2022] PUT /identity/v3/projects/91282698e11b40368d7336d24f407fb3/users/492763f9e33540468d31c12e90604761/roles/b60e4f6e616d4b0bb7f4522d885667be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:53.693990 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d800-c7eb-40f7-a94f-4c07164881d0 None None] REQUEST_METHOD: `POST` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.694301 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d800-c7eb-40f7-a94f-4c07164881d0 None None] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.694938 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d800-c7eb-40f7-a94f-4c07164881d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.722965 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.auth.core [None req-b585d800-c7eb-40f7-a94f-4c07164881d0 None None] MFA Rules not processed for user `492763f9e33540468d31c12e90604761`. Rule list: `[]` (Enabled: `True`). {{(pid=81511) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:53.724150 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-b585d800-c7eb-40f7-a94f-4c07164881d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:53.787088 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1458/2934] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:53.799242 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:53.801199 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:53.858692 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d18c5-2dd1-4fbc-9f49-48d2b4873324 admin admin] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:53.862226 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aee2a-fb45-4843-940a-0baf49363b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23f4b0027d97468c9b6f73381eb76a3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:53.862820 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aee2a-fb45-4843-940a-0baf49363b39 service cinder] REQUEST_METHOD: `GET` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:53.863093 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aee2a-fb45-4843-940a-0baf49363b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:53.863361 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aee2a-fb45-4843-940a-0baf49363b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:53.871786 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53aee2a-fb45-4843-940a-0baf49363b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:53.873215 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53aee2a-fb45-4843-940a-0baf49363b39 service cinder] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:53.882143 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1477/2935] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:56.440058 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d800-c7eb-40f7-a94f-4c07164881d0 None None] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:56.496876 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:56.503872 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d800-c7eb-40f7-a94f-4c07164881d0 None None] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:56.509724 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:56.510395 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:56.510673 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:56.510943 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] PATH_INFO: `/v3/users/492763f9e33540468d31c12e90604761` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:56.512051 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492763f9e33540468d31c12e90604761)` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:56.513944 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:56.560327 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492763f9e33540468d31c12e90604761'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:56.567304 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492763f9e33540468d31c12e90604761'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:56.567939 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492763f9e33540468d31c12e90604761'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:56.575171 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492763f9e33540468d31c12e90604761'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:56.586585 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.notifications [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492763f9e33540468d31c12e90604761'} {{(pid=81511) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:56.592206 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1459/2936] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Sep 9 15:09:56 2022] DELETE /identity/v3/users/492763f9e33540468d31c12e90604761 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:09:56.596731 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] REQUEST_METHOD: `POST` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:56.597194 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:56.597310 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:56.616726 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.auth.core [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] MFA Rules not processed for user `4da2a13608794bc8b00af153bd2654b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81510) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 15:09:56.617909 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:56.674591 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1478/2937] 10.222.0.52 () {58 vars in 958 bytes} [Fri Sep 9 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 15:09:56.684655 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:56.686042 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:56.744769 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5187534-67a4-4028-ac29-b5b51c3eb872 admin admin] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:56.748374 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a92823ec184a86a8ce70ffa1a4424b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:56.749005 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:56.749285 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:56.749553 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:56.759144 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:56.760556 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:56.769784 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1460/2938] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:09:57.034707 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] Authenticating user token {{(pid=81510) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:09:57.036251 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.fernet_utils [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81510) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:09:57.049446 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214987b1-f663-4d01-97b7-33ddd0b6e698 None None] Validating token access rules against request {{(pid=81510) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:09:57.054428 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4da2a13608794bc8b00af153bd2654b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e9f440e31a4fa8b27ec296ec84b4a3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81510) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:09:57.055158 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:09:57.055511 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:09:57.055816 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] PATH_INFO: `/v3/projects/91282698e11b40368d7336d24f407fb3` {{(pid=81510) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:09:57.056945 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91282698e11b40368d7336d24f407fb3)` {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:09:57.058892 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] RBAC: Authorization granted {{(pid=81510) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:09:57.106354 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91282698e11b40368d7336d24f407fb3', 'request_id': 'req-f788d4ce-bea7-4f08-b608-1c5088dea183'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:57.107524 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:09:57.113643 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91282698e11b40368d7336d24f407fb3', 'request_id': 'req-f788d4ce-bea7-4f08-b608-1c5088dea183'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:57.120788 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91282698e11b40368d7336d24f407fb3', 'request_id': 'req-f788d4ce-bea7-4f08-b608-1c5088dea183'} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:57.133418 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] The token cache is being invalidate because project 91282698e11b40368d7336d24f407fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81510) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 15:09:57.133706 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:57.134360 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG keystone.notifications [None req-f788d4ce-bea7-4f08-b608-1c5088dea183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81510) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 15:09:57.135836 dv-cinder-828696-11-smb devstack@keystone.service[81510]: [pid: 81510|app: 0|req: 1479/2939] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Sep 9 15:09:57 2022] DELETE /identity/v3/projects/91282698e11b40368d7336d24f407fb3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 15:10:06.765654 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:10:07.129794 dv-cinder-828696-11-smb devstack@keystone.service[81510]: DEBUG dbcounter [-] [81510] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=81510) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 15:11:58.073494 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] Authenticating user token {{(pid=81511) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 15:11:58.074935 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:11:58.143981 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a686d7-9148-47d8-b5fc-756289a656ad service neutron] Validating token access rules against request {{(pid=81511) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 15:11:58.203237 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7b43a-116e-4461-8ab8-d9c45e1885fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef370b70e8194df9a52c26e21c375730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f0ad2f54a4740899704352ca291354c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81511) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 15:11:58.203833 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7b43a-116e-4461-8ab8-d9c45e1885fe service placement] REQUEST_METHOD: `GET` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 15:11:58.204106 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7b43a-116e-4461-8ab8-d9c45e1885fe service placement] SCRIPT_NAME: `/identity` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 15:11:58.204371 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7b43a-116e-4461-8ab8-d9c45e1885fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81511) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 15:11:58.206142 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.fernet_utils [None req-38d7b43a-116e-4461-8ab8-d9c45e1885fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81511) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 15:11:58.217836 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7b43a-116e-4461-8ab8-d9c45e1885fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 15:11:58.219427 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7b43a-116e-4461-8ab8-d9c45e1885fe service placement] RBAC: Authorization granted {{(pid=81511) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 15:11:58.229148 dv-cinder-828696-11-smb devstack@keystone.service[81511]: [pid: 81511|app: 0|req: 1461/2940] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Sep 9 15:11:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 15:12:08.224924 dv-cinder-828696-11-smb devstack@keystone.service[81511]: DEBUG dbcounter [-] [81511] Writing DB stats keystone:SELECT=58 {{(pid=81511) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}